00000001:02000400:1.0F:1790919259.788286:0:3114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1790919279.501864:0:3335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1790919281.303946:0:3397:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 615 MB/s 00000001:01000000:1.0:1790919281.555837:0:3397:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 654 MB/s 00000001:01000000:2.0F:1790919281.805903:0:3397:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3727 MB/s 00000020:02000000:0.0:1790919282.433922:0:3427:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_g8e10c0d 00000400:02000000:0.0:1790919283.380075:0:3442:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.111@tcp [8/256/0/180] 00008000:02000000:1.0:1790919286.914283:0:3591:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790919346.482008:0:5847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790919354.730914:0:6426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790919354.730920:0:6426:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790919354.731033:0:6426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000093c33034 00000080:02000400:1.0:1790919354.731045:0:6426:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1790919354.737734:0:6426:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790919354.737758:0:6426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790919354.737849:0:6426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000073c7f0ac) 00000020:00000080:0.0:1790919354.737871:0:6426:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790919354.753816:0:6426:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790919354.755321:0:6426:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790919354.777472:0:6426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1790919354.777514:0:6426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790919354.777538:0:6426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790919354.777589:0:6426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790919354.777615:0:6426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790919354.778045:0:6426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790919354.778146:0:6426:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790919354.778212:0:6426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad159130ef 00000020:01000004:1.0:1790919354.778221:0:6426:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790919354.778226:0:6426:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790919354.778232:0:6426:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000093c33034 from MGS 00000020:01000004:1.0:1790919354.778236:0:6426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790919354.778253:0:6426:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005b05f1e9) 00000020:00000080:1.0:1790919354.778265:0:6426:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790919354.778338:0:6426:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000093c33034 from MGS, refs=2 00080000:01000000:1.0:1790919354.778344:0:6426:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790919354.778349:0:6426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad159130fd 00000100:00100000:1.0:1790919354.778445:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790919354.778579:0:6426:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790919354.778585:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790919354.780011:0:6426:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790919354.780021:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790919354.783047:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919354.783265:0:6426:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790919354.783271:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790919354.784675:0:6426:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790919354.784682:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790919354.785003:0:6426:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790919354.785009:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790919354.785711:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919354.785714:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919354.785715:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919354.786022:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919354.786024:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919354.786026:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919354.787420:0:6426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790919354.788677:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790919355.036182:0:6426:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6159 MB/s 00000001:01000000:0.0:1790919355.286096:0:6426:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4895 MB/s 00000001:01000000:0.0:1790919355.536692:0:6426:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 815 MB/s 00000001:01000000:3.0:1790919355.787773:0:6426:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 661 MB/s 00010000:00010000:0.0:1790919355.807916:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1790919355.808513:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1790919355.826176:0:6426:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1790919355.826197:0:6426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790919355.826200:0:6426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790919355.827753:0:6436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790919355.827939:0:6426:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790919355.827981:0:6426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790919355.828645:0:6426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790919355.828674:0:6426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790919355.829796:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919355.830191:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790919355.830198:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790919355.831159:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790919355.831168:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790919355.831532:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790919355.831605:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790919355.832765:0:6426:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790919355.832786:0:6426:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:0.0:1790919355.832788:0:6426:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790919355.832941:0:6426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:0.0:1790919355.832952:0:6426:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (000000007118fb67) 00000020:00000080:0.0:1790919355.832966:0:6426:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790919355.833033:0:6426:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000061133abb@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919355.833224:0:6426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:0.0:1790919355.833235:0:6426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790919355.834088:0:6441:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790919355.837772:0:6443:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790919355.837865:0:6426:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid 1948390b-ad58-4044-9ddd-8f90f3aaa52f) 00000020:00000080:3.0:1790919355.837887:0:6426:0:(genops.c:1384:class_connect()) connect: client 1948390b-ad58-4044-9ddd-8f90f3aaa52f, cookie 0x951c50ad1591310b 00000100:00080000:3.0:1790919355.837899:0:6426:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919355.837908:0:6426:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import 0000000061133abb using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919355.837951:0:6426:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fce5b82b x1877914978091136/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919355.839814:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fce5b82b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978091136:0@lo:250: 00000100:00100000:2.0:1790919355.839897:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919355.839992:0:6426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS 00000020:01000004:3.0:1790919355.840013:0:6426:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790919355.840039:0:6426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790919355.840075:0:6426:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000049864295) 00000020:00000080:3.0:1790919355.840094:0:6426:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790919355.846108:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091136 00000100:00100000:2.0:1790919355.846120:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091136 00000100:00100000:2.0:1790919355.846397:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919355.846404:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002208b8f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3457:x1877914978091136:12345-0@lo:250: 00010000:00080000:2.0:1790919355.846431:0:6438:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1948390b-ad58-4044-9ddd-8f90f3aaa52f@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1790919355.846471:0:6438:0:(genops.c:1384:class_connect()) connect: client 1948390b-ad58-4044-9ddd-8f90f3aaa52f, cookie 0x951c50ad15913119 00000100:00080000:2.0:1790919355.846748:0:6438:0:(import.c:65:import_set_state_nolock()) 00000000c3753d35 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919355.846803:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002208b8f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:3457:x1877914978091136:12345-0@lo:250: Request processed in 399us (6906us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919355.846811:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919355.846855:0:3457:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790919355.846863:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1790919355.846869:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790919355.846880:0:3457:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790919355.846883:0:3457:0:(import.c:65:import_set_state_nolock()) 0000000061133abb MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790919355.846885:0:3457:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790919355.846893:0:3457:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790919355.846899:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fce5b82b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978091136:0@lo:250: 00000100:00100000:3.0:1790919355.853937:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919355.854491:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790919355.854497:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790919355.858045:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790919355.858127:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790919355.858938:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790919355.858946:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790919355.860760:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919355.861769:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790919355.861833:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790919355.862947:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790919355.862956:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790919355.917208:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919355.918899:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790919355.918916:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790919355.920489:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790919355.920500:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790919355.921760:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919355.921925:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790919355.921931:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790919355.924866:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790919355.924880:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790919355.925539:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919355.925712:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790919355.925717:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790919355.926376:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790919355.926383:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790919355.927031:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919355.927427:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790919355.927432:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790919355.932817:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790919355.932835:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790919355.971879:0:6426:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919355.972591:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790919355.972597:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790919355.979102:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790919355.979117:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790919355.980161:0:6426:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790919355.980171:0:6426:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790919355.982475:0:6426:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790919355.982507:0:6426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790919355.982522:0:6426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790919355.982648:0:6426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790919355.982693:0:6426:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790919355.982697:0:6426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790919355.982698:0:6426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919355.982699:0:6426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919355.982701:0:6426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919355.982702:0:6426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919355.982703:0:6426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919355.982704:0:6426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919355.982706:0:6426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919355.982707:0:6426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919355.982708:0:6426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919355.982710:0:6426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919355.982711:0:6426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919355.982713:0:6426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790919355.982715:0:6426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919355.982716:0:6426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919355.982717:0:6426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919355.982718:0:6426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919355.982719:0:6426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919355.982720:0:6426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919355.982721:0:6426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919355.982722:0:6426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919355.982723:0:6426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919355.982724:0:6426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919355.982725:0:6426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919355.982726:0:6426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919355.982760:0:6426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790919355.982775:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a844211 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091264:0@lo:253: 00000100:00100000:3.0:1790919355.982858:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919355.982942:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd873d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919355.983316:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091264 00000100:00100000:2.0:1790919355.983325:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091264 00000100:00100000:2.0:1790919355.983369:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919355.983378:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0416be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:6426:x1877914978091264:12345-0@lo:253: 20000000:01000000:2.0:1790919355.983424:0:6440:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790919355.983432:0:6440:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790919355.983802:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790919355.983853:0:6440:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1790919355.984193:0:6440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919355.985617:0:6462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790919355.987049:0:6440:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790919355.987077:0:6440:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790919355.987082:0:6440:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790919355.987086:0:6440:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790919355.987117:0:6440:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790919355.987623:0:6440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919355.988458:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790919355.988476:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790919355.988529:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790919355.989382:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790919355.989458:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790919355.989582:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790919355.989592:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790919355.989641:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790919355.989648:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790919355.990016:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790919355.990025:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790919355.990370:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790919355.990429:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790919355.990468:0:6440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790919355.990473:0:6440:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790919355.990486:0:6440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919355.991471:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790919355.991489:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790919355.991532:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790919355.991561:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790919355.991612:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790919355.991624:0:6440:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790919355.992187:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790919355.992198:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790919355.992400:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790919355.992441:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790919355.992474:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790919355.992487:0:6440:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790919355.992575:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790919355.992597:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790919355.992641:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790919355.993382:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790919355.993598:0:6440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1790919355.993646:0:6440:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1790919355.993653:0:6440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1790919355.997606:0:6463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790919355.997975:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790919355.998000:0:6440:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:3.0:1790919355.998003:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:3.0:1790919355.998035:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790919355.998042:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790919355.998122:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790919355.998131:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:3.0:1790919355.998175:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790919355.998185:0:6440:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790919355.998219:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790919355.998257:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790919355.998397:0:6440:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790919355.998401:0:6440:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790919355.998405:0:6440:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790919355.998416:0:6440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790919355.998418:0:6440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790919355.998444:0:6440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790919355.998446:0:6440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790919355.998917:0:6464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1790919356.003144:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790919356.003436:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1790919356.003519:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1790919356.003543:0:6440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790919356.003545:0:6440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790919356.005540:0:6465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1790919356.006311:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1790919356.006367:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1790919356.006405:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1790919356.006419:0:6440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790919356.006422:0:6440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1790919356.006438:0:6440:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790919356.006441:0:6440:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790919356.006447:0:6440:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790919356.006453:0:6440:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790919356.010649:0:6466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1790919356.010782:0:6440:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790919356.022878:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1790919356.022936:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1790919356.023036:0:6440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1790919356.023368:0:6440:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790919356.023391:0:6440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023408:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023417:0:6440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023423:0:6440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023430:0:6440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023436:0:6440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023442:0:6440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000538f7c9 already unused, calling callback (000000009f3081ad) 00010000:00010000:0.0:1790919356.023446:0:6440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023453:0:6440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023465:0:6440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023477:0:6440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.023483:0:6440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000538f7c9/0x951c50ad15913120 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919356.023503:0:6440:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790919356.210519:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0416be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:6426:x1877914978091264:12345-0@lo:253: Request processed in 227133us (227653us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.210539:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919356.210767:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a844211 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091264:0@lo:253: 10000000:01000000:0.0:1790919356.210785:0:6426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790919356.210789:0:6426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919356.210791:0:6426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790919356.210792:0:6426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919356.210793:0:6426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790919356.210795:0:6426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919356.210796:0:6426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919356.210797:0:6426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919356.210798:0:6426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790919356.210799:0:6426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790919356.210801:0:6426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919356.210802:0:6426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790919356.210819:0:6426:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000093c33034 from lustre-MDT0000 10000000:01000000:0.0:1790919356.210842:0:6426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790919356.210845:0:6426:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790919356.210849:0:6426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95f3908ab380 10000000:01000000:0.0:1790919356.210852:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919356.210860:0:6426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f3908ab380 from 1 10000000:01000000:0.0:1790919356.210863:0:6426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790919356.210908:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.210919:0:6426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.210940:0:6426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919356.210959:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091392:0@lo:101: 00000100:00100000:0.0:1790919356.210993:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.211130:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f24d2cb going to sleep for 11 seconds 00000100:00100000:2.0:1790919356.211255:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091392 00000100:00100000:2.0:1790919356.211261:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091392 00000100:00100000:2.0:1790919356.211297:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919356.211306:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000012c86634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:6426:x1877914978091392:12345-0@lo:101: 00010000:00010000:2.0:1790919356.211318:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919356.211334:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913127 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919356.211354:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913127 expref: 6 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919356.211364:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913127 expref: 6 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919356.211379:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b22cde1a, rc 0) 00000100:00100000:2.0:1790919356.211423:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000012c86634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:6426:x1877914978091392:12345-0@lo:101: Request processed in 119us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919356.211430:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919356.211533:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091392:0@lo:101: 00010000:00010000:0.0:1790919356.211545:0:6426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.211552:0:6426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919356.211590:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091520:0@lo:501: 00000100:00100000:0.0:1790919356.211611:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919356.211664:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091520 00000100:00100000:1.0:1790919356.211668:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091520 00000100:00100000:1.0:1790919356.211696:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919356.211702:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001eaf8e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:6426:x1877914978091520:12345-0@lo:501: 00000100:00100000:1.0:1790919356.214580:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001eaf8e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:6426:x1877914978091520:12345-0@lo:501: Request processed in 2871us (2961us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919356.214595:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919356.215236:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f24d2cb going to sleep for 11 seconds 00000100:00100000:0.0:1790919356.215263:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091520:0@lo:501: 10000000:01000000:0.0:1790919356.215299:0:6426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790919356.215320:0:6426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215330:0:6426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919356.215338:0:6426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f385571800 10000000:01000000:0.0:1790919356.215343:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919356.215355:0:6426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95f385571800 10000000:01000000:0.0:1790919356.215358:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790919356.215361:0:6426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95f385571800 from 1 10000000:01000000:0.0:1790919356.215364:0:6426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790919356.215396:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215403:0:6426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215413:0:6426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919356.215428:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091648:0@lo:101: 00000100:00100000:0.0:1790919356.215464:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.215486:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f24d2cb going to sleep for 11 seconds 00000100:00100000:3.0:1790919356.215501:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091648 00000100:00100000:3.0:1790919356.215509:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091648 00000100:00100000:3.0:1790919356.215552:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790919356.215564:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005be0ff6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:6426:x1877914978091648:12345-0@lo:101: 00010000:00010000:3.0:1790919356.215576:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919356.215590:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000236551e5/0x951c50ad1591313c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913135 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.215617:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000236551e5/0x951c50ad1591313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913135 expref: 7 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.215625:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000236551e5/0x951c50ad1591313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913135 expref: 7 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.215633:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000236551e5, rc 0) 00000100:00100000:3.0:1790919356.215684:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005be0ff6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+7:6426:x1877914978091648:12345-0@lo:101: Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.215691:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919356.215744:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091648:0@lo:101: 00010000:00010000:0.0:1790919356.215755:0:6426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215763:0:6426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919356.215775:0:6426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790919356.215790:0:6426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215797:0:6426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000c8f1beaa/0x951c50ad15913135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919356.215813:0:6426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790919356.215817:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919356.215821:0:6426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95f385571800 10000000:01000000:0.0:1790919356.215824:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790919356.215827:0:6426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790919356.215829:0:6426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790919356.215843:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215849:0:6426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.215855:0:6426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919356.215864:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091776:0@lo:101: 00000100:00100000:0.0:1790919356.215890:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.215913:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f24d2cb going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.215964:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091776 00000100:00100000:1.0:1790919356.215970:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091776 00000100:00100000:1.0:1790919356.215999:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919356.216005:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bea51c92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+7:6426:x1877914978091776:12345-0@lo:101: 00010000:00010000:1.0:1790919356.216012:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919356.216021:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913143 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919356.216034:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913143 expref: 8 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919356.216040:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913143 expref: 8 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919356.216046:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063330b95, rc 0) 00000100:00100000:1.0:1790919356.216155:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bea51c92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+8:6426:x1877914978091776:12345-0@lo:101: Request processed in 150us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.216162:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919356.216313:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091776:0@lo:101: 00010000:00010000:0.0:1790919356.216323:0:6426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.216329:0:6426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919356.216371:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091904:0@lo:501: 00000100:00100000:0.0:1790919356.216397:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.216432:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f24d2cb going to sleep for 11 seconds 00000100:00100000:2.0:1790919356.216577:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978091904 00000100:00100000:2.0:1790919356.216582:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978091904 00000100:00100000:2.0:1790919356.216616:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919356.216622:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067ab4a34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+8:6426:x1877914978091904:12345-0@lo:501: 00000100:00100000:2.0:1790919356.216870:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067ab4a34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6426:x1877914978091904:12345-0@lo:501: Request processed in 248us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919356.216878:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919356.217038:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978091904:0@lo:501: 00000100:00100000:0.0:1790919356.217086:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092032:0@lo:503: 00000100:00100000:0.0:1790919356.217128:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.217200:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f24d2cb going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.217238:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092032 00000100:00100000:1.0:1790919356.217243:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092032 00000100:00100000:1.0:1790919356.217272:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919356.217277:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d98658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6426:x1877914978092032:12345-0@lo:503: 00000100:00100000:1.0:1790919356.217462:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d98658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6426:x1877914978092032:12345-0@lo:503: Request processed in 185us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.217469:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919356.217573:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092032:0@lo:503: 00000100:00100000:3.0:1790919356.217897:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6468:1877914978092160:0@lo:502: 00000100:00100000:3.0:1790919356.217934:0:6468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919356.218196:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092160 00000100:00100000:2.0:1790919356.218202:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092160 00000100:00100000:3.0:1790919356.218213:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fbd9a55f going to sleep for 11 seconds 00000100:00100000:2.0:1790919356.218278:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919356.218285:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b0e5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6468:x1877914978092160:12345-0@lo:502: 00000100:00100000:2.0:1790919356.218415:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b0e5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6468:x1877914978092160:12345-0@lo:502: Request processed in 127us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919356.218424:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919356.218444:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6468:1877914978092160:0@lo:502: 00000020:01000000:3.0:1790919356.218465:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919356.218475:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919356.218477:0:6468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790919356.218482:0:6468:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790919356.218485:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919356.218497:0:6468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000045353b81) 00000020:00000080:3.0:1790919356.218512:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790919356.218517:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790919356.218578:0:6468:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790919356.218585:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15913158 00000020:00000080:3.0:1790919356.218804:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790919356.218809:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919356.218812:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919356.218813:0:6468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790919356.218823:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919356.218826:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919356.218828:0:6468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790919356.218831:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919356.218838:0:6468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003f9f997a) 00000020:00000080:3.0:1790919356.218848:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790919356.218852:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790919356.218853:0:6468:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790919356.218856:0:6468:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790919356.218862:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790919356.218907:0:6468:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000093c33034 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790919356.218918:0:6468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d7f63718) 00000020:00000080:3.0:1790919356.218925:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790919356.219069:0:6468:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790919356.219076:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591316d 00000020:00000080:3.0:1790919356.219167:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790919356.219173:0:6468:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790919356.219177:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x951c50ad15913174 00080000:01000000:3.0:1790919356.219182:0:6468:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790919356.219185:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad1591317b 00080000:10000000:3.0:1790919356.219538:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1790919356.219726:0:6468:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1790919356.223953:0:6468:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790919356.301049:0:6468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790919356.301444:0:6468:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790919356.307322:0:6468:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790919356.307842:0:6468:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790919356.357026:0:6468:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000306e2f52) 00000020:00000080:3.0:1790919356.357048:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790919356.357154:0:6468:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790919356.357160:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15913189 00000020:00000080:3.0:1790919356.358209:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1790919356.360527:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919356.397641:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919356.437947:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919356.476357:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919356.507815:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919356.549686:0:6468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790919356.578374:0:6468:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x951c50ad15913190 00000020:00000080:0.0:1790919356.578950:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790919356.578962:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919356.578969:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919356.578971:0:6468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790919356.578975:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919356.578980:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919356.578981:0:6468:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790919356.578984:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790919356.578985:0:6468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790919356.578987:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919356.578990:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919356.578991:0:6468:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790919356.578993:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919356.578997:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919356.578998:0:6468:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790919356.579002:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790919356.579191:0:6468:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1790919356.579247:0:6468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6468:1877914978092288:0@lo:502: 00000100:00100000:0.0:1790919356.579322:0:6468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.579441:0:6468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000464175f4 going to sleep for 11 seconds 00000100:00100000:2.0:1790919356.579549:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092288 00000100:00100000:2.0:1790919356.579557:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092288 00000100:00100000:2.0:1790919356.579677:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919356.579687:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003e1fcff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6468:x1877914978092288:12345-0@lo:502: 00000100:00100000:2.0:1790919356.580269:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003e1fcff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6468:x1877914978092288:12345-0@lo:502: Request processed in 582us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919356.580289:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919356.580368:0:6468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa05b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6468:1877914978092288:0@lo:502: 00000020:01000000:0.0:1790919356.580391:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919356.580468:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919356.580477:0:6468:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1790919356.580481:0:6468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790919356.580702:0:6426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790919356.580722:0:6426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790919356.580750:0:6426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.580762:0:6426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919356.580769:0:6426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f385571800 from 1 10000000:01000000:3.0:1790919356.580772:0:6426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790919356.580806:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.580813:0:6426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.580822:0:6426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.580836:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092416:0@lo:101: 00000100:00100000:3.0:1790919356.580872:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.580909:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ca8bea6 going to sleep for 11 seconds 00000100:00100000:0.0:1790919356.580974:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092416 00000100:00100000:0.0:1790919356.580980:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092416 00000100:00100000:0.0:1790919356.581095:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919356.581104:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4da68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:6426:x1877914978092416:12345-0@lo:101: 00010000:00010000:0.0:1790919356.581116:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919356.581138:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913197 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.581159:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913197 expref: 10 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.581168:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913197 expref: 10 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.581242:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077c67a10, rc 0) 00000100:00100000:0.0:1790919356.581275:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4da68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:6426:x1877914978092416:12345-0@lo:101: Request processed in 173us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919356.581281:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919356.581354:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092416:0@lo:101: 00010000:00010000:3.0:1790919356.581365:0:6426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.581373:0:6426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.581944:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092544:0@lo:256: 00000100:00100000:3.0:1790919356.581986:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.582416:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ca8bea6 going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.582490:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092544 00000100:00100000:1.0:1790919356.582498:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092544 00000100:00100000:1.0:1790919356.582526:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919356.582533:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000014198d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:6426:x1877914978092544:12345-0@lo:256: 20000000:01000000:1.0:1790919356.582552:0:6440:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790919356.582557:0:6440:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790919356.582636:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000014198d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:6426:x1877914978092544:12345-0@lo:256: Request processed in 103us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.582643:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919356.582726:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092544:0@lo:256: 10000000:01000000:3.0:1790919356.583463:0:6426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790919356.583490:0:6426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583501:0:6426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919356.583508:0:6426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385571800 from 1 10000000:01000000:3.0:1790919356.583511:0:6426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919356.583541:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583548:0:6426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583556:0:6426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.583572:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092672:0@lo:101: 00000100:00100000:3.0:1790919356.583610:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.583631:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ca8bea6 going to sleep for 11 seconds 00000100:00100000:3.0:1790919356.583654:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092672 00000100:00100000:3.0:1790919356.583658:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092672 00000100:00100000:3.0:1790919356.583694:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919356.583700:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008f1a48c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:6426:x1877914978092672:12345-0@lo:101: 00010000:00010000:3.0:1790919356.583710:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919356.583721:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159131a5 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583750:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159131a5 expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583759:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159131a5 expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583766:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009cb374c0, rc 0) 00000100:00100000:3.0:1790919356.583797:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008f1a48c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978092672:12345-0@lo:101: Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.583804:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919356.583838:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092672:0@lo:101: 00010000:00010000:3.0:1790919356.583850:0:6426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.583857:0:6426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.583899:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092800:0@lo:501: 00000100:00100000:3.0:1790919356.583920:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.583932:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ca8bea6 going to sleep for 11 seconds 00000100:00100000:3.0:1790919356.583943:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092800 00000100:00100000:3.0:1790919356.583946:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092800 00000100:00100000:3.0:1790919356.583959:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919356.583970:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b34f59f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978092800:12345-0@lo:501: 00000100:00100000:3.0:1790919356.584625:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b34f59f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978092800:12345-0@lo:501: Request processed in 654us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.584633:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919356.584696:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092800:0@lo:501: 00000100:00100000:3.0:1790919356.584727:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092928:0@lo:503: 00000100:00100000:3.0:1790919356.584776:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.584790:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ca8bea6 going to sleep for 11 seconds 00000100:00100000:3.0:1790919356.584805:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978092928 00000100:00100000:3.0:1790919356.584809:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978092928 00000100:00100000:3.0:1790919356.584827:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919356.584833:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000054e5ead pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978092928:12345-0@lo:503: 00000040:00080000:3.0:1790919356.584865:0:6440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919356.584902:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000054e5ead pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978092928:12345-0@lo:503: Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.584908:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919356.584943:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978092928:0@lo:503: 00000040:00080000:1.0:1790919356.585945:0:6472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790919356.586470:0:6426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790919356.586490:0:6426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919356.586532:0:6426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.586544:0:6426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919356.586590:0:6426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919356.586593:0:6426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f385571800 10000000:01000000:3.0:1790919356.586605:0:6426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f385571800 10000000:01000000:3.0:1790919356.586608:0:6426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919356.586614:0:6426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f385571800 from 1 10000000:01000000:3.0:1790919356.586616:0:6426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919356.586643:0:6426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.586651:0:6426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.586661:0:6426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.586679:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093056:0@lo:101: 00000100:00100000:3.0:1790919356.586738:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.586776:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fbd9a55f going to sleep for 11 seconds 00000100:00100000:3.0:1790919356.586798:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093056 00000100:00100000:3.0:1790919356.586803:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093056 00000100:00100000:3.0:1790919356.586872:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919356.586881:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007466800f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978093056:12345-0@lo:101: 00010000:00010000:3.0:1790919356.586893:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919356.586905:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159131b3 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.586925:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159131b3 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.586934:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159131b3 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.586941:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b0b70a4, rc 0) 00000100:00100000:3.0:1790919356.586983:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007466800f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6426:x1877914978093056:12345-0@lo:101: Request processed in 104us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.586989:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919356.587098:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073a1af26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093056:0@lo:101: 00010000:00010000:2.0:1790919356.587112:0:6426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919356.587120:0:6426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919356.587363:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093184:0@lo:501: 00000100:00100000:2.0:1790919356.587392:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919356.587412:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc97f3e6 going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.587468:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093184 00000100:00100000:1.0:1790919356.587473:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093184 00000100:00100000:1.0:1790919356.587493:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790919356.587500:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000048d79727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6426:x1877914978093184:12345-0@lo:501: 00000100:00100000:1.0:1790919356.587759:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000048d79727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6426:x1877914978093184:12345-0@lo:501: Request processed in 260us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.587767:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919356.587844:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093184:0@lo:501: 00000100:00100000:2.0:1790919356.587873:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093312:0@lo:503: 00000100:00100000:2.0:1790919356.587912:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919356.587941:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc97f3e6 going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.587992:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093312 00000100:00100000:1.0:1790919356.587997:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093312 00000100:00100000:1.0:1790919356.588015:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919356.588021:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d63d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6426:x1877914978093312:12345-0@lo:503: 00000100:00100000:1.0:1790919356.588459:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d63d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6426:x1877914978093312:12345-0@lo:503: Request processed in 438us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.588467:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919356.588552:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093312:0@lo:503: 00000100:00100000:2.0:1790919356.589493:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6473:1877914978093440:0@lo:502: 00000100:00100000:2.0:1790919356.589546:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919356.589609:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 000000003eb9bc27 going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.589648:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093440 00000100:00100000:1.0:1790919356.589654:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093440 00000100:00100000:1.0:1790919356.589719:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790919356.589726:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007fa3c809 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6473:x1877914978093440:12345-0@lo:502: 00000100:00100000:1.0:1790919356.590026:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007fa3c809 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6473:x1877914978093440:12345-0@lo:502: Request processed in 301us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.590034:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919356.590360:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6473:1877914978093440:0@lo:502: 00000020:01000004:2.0:1790919356.590416:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790919356.590441:0:6473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000996f3364) 00000020:00000080:2.0:1790919356.590460:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1790919356.590539:0:6473:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000093c33034 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790919356.590543:0:6473:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000093c33034 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790919356.590551:0:6473:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000093c33034 4 00010000:00080000:2.0:1790919356.590593:0:6473:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002cfca4ef@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919356.592851:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1790919356.593344:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790919356.593391:0:6473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790919356.593402:0:6473:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x951c50ad159131c8 00000100:00080000:3.0:1790919356.593411:0:6473:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919356.593420:0:6473:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002cfca4ef using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919356.593451:0:6473:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000093e8a8be x1877914978093568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919356.593503:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093e8a8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978093568:0@lo:38: 00000100:00100000:0.0:1790919356.593573:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919356.593635:0:6473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790919356.593819:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093568 00000100:00100000:1.0:1790919356.593827:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093568 00000100:00100000:1.0:1790919356.593865:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919356.593872:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000aa05b4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978093568:12345-0@lo:38: 00000100:00100000:1.0:1790919356.594089:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000aa05b4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978093568:12345-0@lo:38: Request processed in 215us (516us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790919356.594097:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919356.598816:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b704324a pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6473:1877914978093696:0@lo:502: 00000100:00100000:3.0:1790919356.598900:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.598930:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af6b6a7b going to sleep for 11 seconds 00000100:00100000:3.0:1790919356.598953:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093696 00000100:00100000:3.0:1790919356.598960:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093696 00000100:00100000:3.0:1790919356.598998:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919356.599005:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000fbf1951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6473:x1877914978093696:12345-0@lo:502: 00000100:00100000:0.0:1790919356.599601:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919356.599609:0:3457:0:(import.c:65:import_set_state_nolock()) 000000002cfca4ef lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919356.599613:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790919356.599617:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093e8a8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978093568:0@lo:38: 00000100:00100000:3.0:1790919356.599692:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000fbf1951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6473:x1877914978093696:12345-0@lo:502: Request processed in 687us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.599700:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790919356.602474:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b704324a pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6473:1877914978093696:0@lo:502: 00000040:00080000:1.0:1790919356.602516:0:6473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790919356.603453:0:6426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790919356.603479:0:6426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790919356.603498:0:6426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919356.603510:0:6426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790919356.603655:0:6426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790919356.603658:0:6426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919356.603660:0:6426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919356.603661:0:6426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919356.603662:0:6426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919356.603663:0:6426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919356.603664:0:6426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919356.603670:0:6426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919356.603672:0:6426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919356.603673:0:6426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919356.603674:0:6426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919356.603675:0:6426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790919356.603678:0:6426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1790919356.603680:0:6426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919356.603681:0:6426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919356.603682:0:6426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919356.603683:0:6426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919356.603684:0:6426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919356.603684:0:6426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919356.603685:0:6426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919356.603686:0:6426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919356.603687:0:6426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919356.603688:0:6426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919356.603689:0:6426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919356.603689:0:6426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790919356.603712:0:6426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790919356.603728:0:6426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d313bf61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093824:0@lo:253: 00000100:00100000:3.0:1790919356.603801:0:6426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.603872:0:6426:0:(client.c:2716:ptlrpc_set_wait()) set 00000000caf1f042 going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.603912:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093824 00000100:00100000:1.0:1790919356.603924:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093824 00000100:00100000:1.0:1790919356.603999:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919356.604007:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007e2bca21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6426:x1877914978093824:12345-0@lo:253: 20000000:01000000:1.0:1790919356.604034:0:6438:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790919356.604046:0:6438:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790919356.628464:0:6438:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790919356.628479:0:6438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790919356.628522:0:6461:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790919356.628527:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790919356.628544:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.628563:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913197 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.628571:0:6461:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.628607:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913197 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919356.628636:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913197 expref: 12 pid: 6438 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.628650:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b288c34c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978093952:0@lo:104: 00000100:00100000:3.0:1790919356.628706:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919356.628764:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 00000000266f4f02 going to sleep for 11 seconds 00000100:00100000:1.0:1790919356.628837:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978093952 00000100:00100000:1.0:1790919356.628846:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978093952 00000100:00100000:1.0:1790919356.628894:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919356.628902:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008d6cb6e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978093952:12345-0@lo:104: 00010000:00010000:1.0:1790919356.628914:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919356.628967:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919356.628971:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008d6cb6e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978093952:12345-0@lo:104: Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919356.628978:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919356.629013:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b288c34c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978093952:0@lo:104: 00010000:00010000:1.0:1790919356.629029:0:6461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629201:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919356.629207:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629221:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000da5b6c16 already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919356.629224:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629230:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919356.629235:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919356.629240:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919356.629275:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629281:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919356.629297:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629303:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000da5b6c16/0x951c50ad15913197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591319e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629317:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919356.629319:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919356.629321:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919356.629367:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000563b57f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978094080:0@lo:103: 00000100:00100000:0.0:1790919356.629400:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919356.629466:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094080 00000100:00100000:0.0:1790919356.629470:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094080 00010000:00010000:0.0:1790919356.629484:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913197 expref: 13 pid: 6438 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919356.629513:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919356.629519:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ec932e25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:3459:x1877914978094080:12345-0@lo:103: 00010000:00010000:0.0:1790919356.629529:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919356.629533:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913197 expref: 13 pid: 6438 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629542:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913197 expref: 13 pid: 6438 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629553:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077c67a10/0x951c50ad1591319e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913197 expref: 13 pid: 6438 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629565:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629571:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919356.629582:0:6430:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001055550s 00010000:00010000:0.0:1790919356.629585:0:6430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629591:0:6430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629597:0:6430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629602:0:6430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629614:0:6430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf0fc1ab already unused, calling callback (000000009f3081ad) 00010000:00010000:0.0:1790919356.629617:0:6430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629624:0:6430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629636:0:6430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629645:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919356.629673:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ec932e25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:3459:x1877914978094080:12345-0@lo:103: Request processed in 154us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919356.629680:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919356.629708:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000563b57f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978094080:0@lo:103: 00010000:00010000:0.0:1790919356.629724:0:6461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629741:0:6461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919356.629745:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cf0fc1ab/0x951c50ad159131cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919356.635537:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007e2bca21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6426:x1877914978093824:12345-0@lo:253: Request processed in 31524us (31729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919356.635551:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919356.635645:0:6426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d313bf61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6426:1877914978093824:0@lo:253: 10000000:01000000:0.0:1790919356.635664:0:6426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790919356.635667:0:6426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919356.635672:0:6426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790919356.635688:0:6426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919356.635689:0:6426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919356.635690:0:6426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919356.635692:0:6426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919356.635693:0:6426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919356.635694:0:6426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790919356.635696:0:6426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790919356.635697:0:6426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790919356.635699:0:6426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919356.635700:0:6426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790919356.635714:0:6426:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790919356.641104:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919356.641499:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919356.641706:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919356.641903:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919356.642136:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919356.642306:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919356.644608:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919356.644801:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919356.645000:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919356.645465:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919356.645666:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919356.645851:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1790919356.680601:0:6426:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1790919356.725048:0:6426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1790919356.725641:0:6479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1790919356.731467:0:6478:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1790919356.731477:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790919356.737870:0:6426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790919356.738244:0:6426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790919356.738785:0:6426:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790919356.738793:0:6426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790919356.738923:0:6426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919356.744306:0:6426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790919356.746080:0:6426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790919356.746157:0:6426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1790919356.746643:0:6426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790919356.746834:0:6426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1790919356.748753:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1790919356.748919:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1790919356.749312:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1790919356.749661:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1790919356.749819:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1790919356.749976:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1790919356.750550:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1790919356.750706:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1790919356.750851:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1790919356.750995:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1790919356.751262:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1790919356.751415:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790919356.751561:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790919356.751744:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790919356.751880:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790919356.752037:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790919356.752727:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790919356.752895:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790919356.753260:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790919356.753412:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790919356.754398:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790919356.755259:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790919356.755428:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790919356.755607:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790919356.755757:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790919356.755907:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790919356.756046:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790919356.756250:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790919356.756399:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790919356.756581:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790919356.756711:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790919356.756887:0:6426:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790919356.757093:0:6426:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1790919356.786365:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:0.0:1790919356.829444:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790919356.863945:0:6426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790919356.863986:0:6426:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa204c1c7f988 00100000:10000000:2.0:1790919356.863993:0:6426:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790919356.865312:0:6426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790919356.865330:0:6426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790919356.865344:0:6426:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790919356.865373:0:6426:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1790919356.872326:0:6479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790919356.872400:0:6479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790919356.872405:0:6479:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790919357.852610:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919358.877285:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919359.902276:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919360.819297:0:6722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790919360.924892:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919361.950341:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919361.955396:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790919361.955407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790919361.955410:0:8:0:(import.c:65:import_set_state_nolock()) 000000002cfca4ef lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919361.955427:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002cfca4ef using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919361.955449:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007fced032 x1877914978094336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919361.955503:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fced032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978094336:0@lo:38: 00000100:00100000:1.0:1790919361.955566:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919361.956079:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919361.956210:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978094208:0@lo:400: 00000100:00100000:2.0:1790919361.956250:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919361.956657:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094336 00000100:00100000:3.0:1790919361.956666:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094336 00000100:00100000:3.0:1790919361.956709:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919361.956715:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000a008682 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978094336:12345-0@lo:38: 00010000:00080000:3.0:1790919361.958498:0:6447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1790919361.958541:0:6447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x951c50ad159131d6 00000004:00100000:3.0:1790919361.958589:0:6447:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790919361.958713:0:6447:0:(import.c:65:import_set_state_nolock()) 000000003e71bfcc : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919361.958809:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000a008682 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1877914978094336:12345-0@lo:38: Request processed in 2091us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919361.958818:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919361.958855:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094208 00000100:00100000:3.0:1790919361.958869:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094208 00000100:00100000:3.0:1790919361.958918:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919361.958926:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009840cd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:3461:x1877914978094208:12345-0@lo:400: 00000100:00100000:3.0:1790919361.958966:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009840cd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:3461:x1877914978094208:12345-0@lo:400: Request processed in 42us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919361.958973:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919361.959021:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978094208:0@lo:400: 00010000:00080000:2.0:1790919361.959251:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007fced032 x1877914978094336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790919361.959267:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790919361.959280:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790919361.959285:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790919361.959287:0:3457:0:(import.c:65:import_set_state_nolock()) 000000002cfca4ef lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790919361.959294:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fced032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978094336:0@lo:38: 00010000:00010000:3.0:1790919362.973877:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919364.000705:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919365.020732:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790919365.023735:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790919365.023744:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f385571800 from 3 10000000:01000000:1.0:1790919365.023748:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790919365.023793:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919365.023815:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919365.023825:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919365.023846:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978094464:0@lo:101: 00000100:00100000:1.0:1790919365.023921:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919365.023978:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035246d7a going to sleep for 11 seconds 00000100:00100000:3.0:1790919365.024119:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094464 00000100:00100000:3.0:1790919365.024127:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094464 00000100:00100000:3.0:1790919365.024178:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790919365.024187:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006b88aa32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:6443:x1877914978094464:12345-0@lo:101: 00010000:00010000:3.0:1790919365.024199:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919365.024211:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159131dd expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919365.024231:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159131dd expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919365.024240:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159131dd expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919365.024248:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000575e8b99, rc 0) 00000100:00100000:3.0:1790919365.024295:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006b88aa32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6443:x1877914978094464:12345-0@lo:101: Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919365.024301:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919365.027255:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978094464:0@lo:101: 00010000:00010000:1.0:1790919365.027286:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919365.027298:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919365.027379:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978094592:0@lo:256: 00000100:00100000:1.0:1790919365.027440:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919365.027475:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035246d7a going to sleep for 11 seconds 00000100:00100000:0.0:1790919365.029969:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094592 00000100:00100000:0.0:1790919365.029984:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094592 00000100:00100000:0.0:1790919365.030076:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919365.030085:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000001b110fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6443:x1877914978094592:12345-0@lo:256: 20000000:01000000:0.0:1790919365.030111:0:6440:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919365.030134:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919365.030137:0:6440:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790919365.030259:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000001b110fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6443:x1877914978094592:12345-0@lo:256: Request processed in 175us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919365.030276:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919365.030658:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978094592:0@lo:256: 10000000:01000000:1.0:1790919365.030724:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919365.030732:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919365.030744:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919366.044874:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919367.068374:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978094720:0@lo:400: 00000100:00100000:1.0:1790919367.068454:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919367.068596:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919367.068619:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094720 00000100:00100000:0.0:1790919367.068634:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094720 00000100:00100000:0.0:1790919367.068753:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919367.068764:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001c84e3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:3461:x1877914978094720:12345-0@lo:400: 00000100:00100000:0.0:1790919367.068861:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001c84e3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:3461:x1877914978094720:12345-0@lo:400: Request processed in 98us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919367.068869:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919367.069412:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049112cca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978094848:0@lo:400: 00000100:00100000:1.0:1790919367.069540:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919367.069827:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094848 00000100:00100000:1.0:1790919367.069837:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094848 00000100:00100000:1.0:1790919367.070162:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919367.070172:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000926e14d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978094848:12345-0@lo:400: 00000100:00100000:1.0:1790919367.070228:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000926e14d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978094848:12345-0@lo:400: Request processed in 59us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919367.070235:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790919367.070558:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000049112cca x1877914978094848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919367.070572:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049112cca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978094848:0@lo:400: 00000100:00100000:1.0:1790919367.070607:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978094720:0@lo:400: 00010000:00010000:1.0:1790919368.094297:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919369.116193:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919370.135845:0:7234:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790919370.135849:0:7234:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:0.0:1790919370.135986:0:7234:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f93a7e85 00000020:01000004:0.0:1790919370.136001:0:7234:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1790919370.136011:0:7234:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790919370.136022:0:7234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000053272fb8) 00000020:00000080:0.0:1790919370.136035:0:7234:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1790919370.144365:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790919370.159506:0:7234:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1790919370.160135:0:7234:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1790919370.187860:0:7234:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790919370.187900:0:7234:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790919370.187924:0:7234:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790919370.187976:0:7234:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790919370.188003:0:7234:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790919370.188876:0:7234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1790919370.188886:0:7234:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790919370.188895:0:7234:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159131f2 00000020:01000004:0.0:1790919370.188901:0:7234:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:0.0:1790919370.188922:0:7234:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790919370.188925:0:7234:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790919370.188931:0:7234:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1790919370.188959:0:7234:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:0.0:1790919370.188963:0:7234:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790919370.218784:0:7234:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790919370.218817:0:7234:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1790919370.218821:0:7234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790919370.218823:0:7234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790919370.218824:0:7234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919370.218825:0:7234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919370.218827:0:7234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919370.218828:0:7234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919370.218829:0:7234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919370.218830:0:7234:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790919370.218831:0:7234:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790919370.218833:0:7234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919370.218834:0:7234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919370.218837:0:7234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1790919370.218839:0:7234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919370.218840:0:7234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790919370.218841:0:7234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919370.218842:0:7234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919370.218843:0:7234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919370.218843:0:7234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919370.218844:0:7234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919370.218845:0:7234:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790919370.218846:0:7234:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790919370.218847:0:7234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919370.218848:0:7234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919370.218871:0:7234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790919370.218884:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978094976:0@lo:253: 00000100:00100000:2.0:1790919370.218945:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919370.218998:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000013eeb64 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.219193:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978094976 00000100:00100000:1.0:1790919370.219202:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978094976 00000100:00100000:1.0:1790919370.219240:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919370.219247:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000956a29f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978094976:12345-0@lo:253: 20000000:01000000:1.0:1790919370.219272:0:6438:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790919370.219276:0:6438:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1790919370.219280:0:6438:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1790919370.219283:0:6438:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1790919370.219588:0:6438:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1790919370.221557:0:6438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919370.221811:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1790919370.221827:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790919370.221871:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790919370.221919:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790919370.221960:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790919370.224596:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1790919370.224622:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1790919370.224738:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1790919370.224748:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1790919370.224783:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1790919370.224790:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1790919370.224822:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790919370.224874:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790919370.226983:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1790919370.227000:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1790919370.227032:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1790919370.227039:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790919370.227128:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1790919370.227137:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1790919370.228717:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1790919370.228743:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1790919370.228815:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790919370.228885:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790919370.228929:0:6438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1790919370.230965:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1790919370.230984:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1790919370.231010:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1790919370.233883:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1790919370.233998:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1790919370.234013:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1790919370.234046:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1790919370.234581:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1790919370.234593:0:6438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1790919370.234730:0:6438:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1790919370.234738:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1790919370.236436:0:7235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1790919370.236991:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790919370.237016:0:6438:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:2.0:1790919370.237019:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1790919370.237122:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790919370.237131:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790919370.237161:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790919370.237167:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1790919370.237413:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790919370.237426:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1790919370.237456:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1790919370.237491:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1790919370.237929:0:6438:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1790919370.237939:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1790919370.239581:0:7236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1790919370.239961:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790919370.239987:0:6438:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:2.0:1790919370.239990:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1790919370.240026:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790919370.240034:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790919370.240444:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790919370.240454:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1790919370.240489:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790919370.240718:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1790919370.240761:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790919370.240813:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1790919370.240838:0:6438:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790919370.240840:0:6438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790919370.240844:0:6438:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790919370.240855:0:6438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790919370.240871:0:6438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790919370.240904:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790919370.240907:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790919370.242342:0:7237:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1790919370.242411:0:7237:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1790919370.242467:0:7237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1790919370.244866:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1790919370.244910:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1790919370.245027:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1790919370.245072:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790919370.245075:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919370.246967:0:7238:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919370.247044:0:7238:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919370.247222:0:7238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790919370.247596:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1790919370.247654:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1790919370.247690:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1790919370.247703:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790919370.247705:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919370.248214:0:7239:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919370.248254:0:7239:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919370.248302:0:7239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1790919370.248503:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790919370.248538:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790919370.248613:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1790919370.248630:0:6438:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790919370.248640:0:6438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790919370.248645:0:6438:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790919370.248651:0:6438:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790919370.248905:0:7240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1790919370.249006:0:6438:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790919370.257543:0:6438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790919370.257567:0:6438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257585:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913127 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257592:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913143 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257598:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159131b3 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257604:0:6438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257668:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159131b3 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257682:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159131b3 expref: 12 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.257699:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978095104:0@lo:104: 00000100:00100000:1.0:1790919370.257767:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919370.257862:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913143 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.257870:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913143 expref: 12 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.257878:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004942f0be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978095232:0@lo:104: 00000100:00100000:1.0:1790919370.257899:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919370.258010:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913127 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.258018:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913127 expref: 12 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.258026:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d471725e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978095360:0@lo:104: 00000100:00100000:1.0:1790919370.258168:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.258438:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095104 00000100:00100000:3.0:1790919370.258446:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095104 00000100:00100000:3.0:1790919370.258481:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095232 00000100:00100000:3.0:1790919370.258483:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095232 00000100:00100000:3.0:1790919370.258496:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919370.258502:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000049112cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978095104:12345-0@lo:104: 00010000:00010000:3.0:1790919370.258513:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258568:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919370.258573:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000049112cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978095104:12345-0@lo:104: Request processed in 72us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.258580:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919370.258596:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919370.258601:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aa6d98d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978095232:12345-0@lo:104: 00010000:00010000:3.0:1790919370.258608:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258651:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919370.258655:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aa6d98d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978095232:12345-0@lo:104: Request processed in 55us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.258671:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790919370.258688:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919370.258692:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258699:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009d56633 already unused, calling callback (000000009d3db3fa) 10000000:00010000:3.0:1790919370.258702:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258710:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919370.258716:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919370.258721:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919370.258747:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258754:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919370.258769:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258775:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000009d56633/0x951c50ad159131b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131ba expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258786:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919370.258789:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258805:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009444514c already unused, calling callback (000000009d3db3fa) 10000000:00010000:3.0:1790919370.258807:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258813:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919370.258818:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919370.258822:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919370.258834:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258840:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919370.258857:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258864:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad15913143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591314a expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.258875:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919370.258877:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919370.258878:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919370.258897:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f221f008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978095488:0@lo:103: 00000100:00100000:3.0:1790919370.258924:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.258964:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978095616:0@lo:103: 00000100:00100000:3.0:1790919370.258985:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.259022:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095488 00000100:00100000:3.0:1790919370.259038:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095488 00010000:00010000:3.0:1790919370.259072:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159131b3 expref: 13 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919370.259092:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095616 00000100:00100000:3.0:1790919370.259095:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095616 00010000:00010000:3.0:1790919370.259105:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913143 expref: 14 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919370.259117:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919370.259122:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cdbb6373 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:3459:x1877914978095488:12345-0@lo:103: 00010000:00010000:3.0:1790919370.259142:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919370.259147:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159131b3 expref: 14 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.259156:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159131b3 expref: 14 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.259171:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919370.259198:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cdbb6373 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:3459:x1877914978095488:12345-0@lo:103: Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.259205:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919370.259217:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919370.259223:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000092caef1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:3460:x1877914978095616:12345-0@lo:103: 00010000:00010000:3.0:1790919370.259230:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919370.259233:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913143 expref: 13 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.259240:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913143 expref: 13 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.259255:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919370.259280:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000092caef1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:3460:x1877914978095616:12345-0@lo:103: Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.259287:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919370.259321:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978095616:0@lo:103: 00000100:00100000:3.0:1790919370.259341:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f221f008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978095488:0@lo:103: 00010000:00010000:0.0:1790919370.259447:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919370.259640:0:6438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132a9122 going to sleep for 11 seconds 00010000:00010000:1.0:1790919370.259654:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b0b70a4/0x951c50ad159131ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159131b3 expref: 12 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.259664:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978095104:0@lo:104: 00010000:00010000:1.0:1790919370.259682:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063330b95/0x951c50ad1591314a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913143 expref: 11 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.259691:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004942f0be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978095232:0@lo:104: 00000100:00100000:3.0:1790919370.259725:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095360 00000100:00100000:3.0:1790919370.259729:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095360 00000100:00100000:3.0:1790919370.259756:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919370.259761:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004d2a48b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978095360:12345-0@lo:104: 00010000:00010000:3.0:1790919370.259771:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.259904:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919370.259909:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004d2a48b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978095360:12345-0@lo:104: Request processed in 148us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.259914:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919370.259952:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d471725e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978095360:0@lo:104: 00010000:00010000:1.0:1790919370.259971:0:6438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.260001:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919370.260005:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.260012:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000538f7c9 already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919370.260015:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.260021:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919370.260276:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.260284:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919370.260343:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.260350:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790919370.260569:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000563b57f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978095744:0@lo:103: 00000100:00100000:1.0:1790919370.260602:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919370.260661:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.260670:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591312e expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.260684:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919370.260686:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919370.260687:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919370.260748:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095744 00000100:00100000:2.0:1790919370.260753:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095744 00010000:00010000:2.0:1790919370.260772:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913127 expref: 11 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919370.260794:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919370.260800:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d471725e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:3461:x1877914978095744:12345-0@lo:103: 00010000:00010000:2.0:1790919370.260809:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919370.260812:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913127 expref: 11 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260821:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913127 expref: 11 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260832:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b22cde1a/0x951c50ad1591312e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913127 expref: 11 pid: 6439 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260843:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260851:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260864:0:6430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260870:0:6430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260888:0:6430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260893:0:6430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260898:0:6430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d8951bc already unused, calling callback (000000009f3081ad) 00010000:00010000:2.0:1790919370.260901:0:6430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260908:0:6430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260920:0:6430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.260929:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919370.261120:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d471725e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:3461:x1877914978095744:12345-0@lo:103: Request processed in 320us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.261127:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919370.261325:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000563b57f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978095744:0@lo:103: 00010000:00010000:1.0:1790919370.261347:0:6438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.261355:0:6438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.261360:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d8951bc/0x951c50ad159131f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790919370.261375:0:6438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790919370.343245:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000956a29f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:7234:x1877914978094976:12345-0@lo:253: Request processed in 123990us (124292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.343260:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919370.343300:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014b8d3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978094976:0@lo:253: 10000000:01000000:0.0:1790919370.343315:0:7234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790919370.343317:0:7234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919370.343319:0:7234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790919370.343321:0:7234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919370.343322:0:7234:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1790919370.343323:0:7234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919370.343324:0:7234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919370.343326:0:7234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919370.343327:0:7234:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790919370.343329:0:7234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919370.343330:0:7234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790919370.343424:0:7234:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f93a7e85 from lustre-MDT0001 10000000:01000000:0.0:1790919370.343447:0:7234:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790919370.343450:0:7234:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790919370.343456:0:7234:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f3908ab380 local copy 10000000:01000000:0.0:1790919370.343459:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790919370.343728:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.343738:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.343944:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.343975:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978095872:0@lo:101: 00000100:00100000:0.0:1790919370.344015:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919370.344154:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978095872 00000100:00100000:2.0:1790919370.344161:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978095872 00000100:00100000:0.0:1790919370.344438:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045be496a going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.344514:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919370.344524:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000001ed4d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+9:7234:x1877914978095872:12345-0@lo:101: 00010000:00010000:2.0:1790919370.344537:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919370.344550:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b22cde1a/0x951c50ad15913207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913200 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.344579:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b22cde1a/0x951c50ad15913207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913200 expref: 10 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.344588:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b22cde1a/0x951c50ad15913207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913200 expref: 10 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.344596:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b22cde1a, rc 0) 00000100:00100000:2.0:1790919370.344892:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000001ed4d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:7234:x1877914978095872:12345-0@lo:101: Request processed in 370us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.344899:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919370.344991:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978095872:0@lo:101: 00010000:00010000:0.0:1790919370.345004:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.345012:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.345221:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096000:0@lo:501: 00000100:00100000:0.0:1790919370.345254:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.346605:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045be496a going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.351526:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096000 00000100:00100000:2.0:1790919370.351542:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096000 00000100:00100000:2.0:1790919370.351680:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919370.351690:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001db40904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:7234:x1877914978096000:12345-0@lo:501: 00000100:00100000:2.0:1790919370.351972:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001db40904 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:7234:x1877914978096000:12345-0@lo:501: Request processed in 282us (6716us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919370.351980:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790919370.353174:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096000:0@lo:501: 10000000:01000000:0.0:1790919370.353210:0:7234:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790919370.353256:0:7234:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790919370.353264:0:7234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.353274:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.353281:0:7234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.353310:0:7234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790919370.353341:0:7234:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3b4712800 10000000:01000000:0.0:1790919370.353352:0:7234:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919370.353358:0:7234:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95f3908ab380 10000000:01000000:0.0:1790919370.353360:0:7234:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790919370.353364:0:7234:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95f3908ab380 from 1 10000000:01000000:0.0:1790919370.353366:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790919370.353395:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.353402:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.353411:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.353426:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096128:0@lo:101: 00000100:00100000:0.0:1790919370.353469:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919370.353522:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919370.353528:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.353535:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000538f7c9 already unused, calling callback (000000009d3db3fa) 10000000:00010000:1.0:1790919370.353538:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.353557:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919370.353563:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919370.353569:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919370.353585:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.353590:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919370.353606:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.353611:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000000538f7c9/0x951c50ad15913200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913207 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.353641:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919370.353643:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919370.353644:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919370.354979:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:3.0:1790919370.355415:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096128 00000100:00100000:3.0:1790919370.355423:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096128 00000100:00100000:3.0:1790919370.355464:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790919370.355470:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007e46e28c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+10:7234:x1877914978096128:12345-0@lo:101: 00010000:00010000:3.0:1790919370.355485:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919370.355500:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009d56633/0x951c50ad15913215 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591320e expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.355520:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009d56633/0x951c50ad15913215 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591320e expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.355540:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009d56633/0x951c50ad15913215 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591320e expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.355548:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009d56633, rc 0) 00000100:00100000:3.0:1790919370.355604:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007e46e28c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:7234:x1877914978096128:12345-0@lo:101: Request processed in 134us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.355610:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919370.355759:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096128:0@lo:101: 00010000:00010000:0.0:1790919370.355775:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.355783:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.355802:0:7234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790919370.355813:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.355819:0:7234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000462bb84a/0x951c50ad1591320e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.355835:0:7234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95f3b4712800 10000000:01000000:0.0:1790919370.355839:0:7234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790919370.355843:0:7234:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95f3b4712800 from 1 10000000:01000000:0.0:1790919370.355845:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790919370.355868:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.355874:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.355881:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.355895:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096384:0@lo:101: 00000100:00100000:0.0:1790919370.355927:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.355942:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:3.0:1790919370.356266:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096384 00000100:00100000:3.0:1790919370.356271:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096384 00000100:00100000:3.0:1790919370.356289:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919370.356293:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a81b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:7234:x1877914978096384:12345-0@lo:101: 00010000:00010000:3.0:1790919370.356300:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919370.356307:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da5b6c16/0x951c50ad15913223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591321c expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.356320:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da5b6c16/0x951c50ad15913223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591321c expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.356327:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da5b6c16/0x951c50ad15913223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591321c expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.356333:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da5b6c16, rc 0) 00000100:00100000:3.0:1790919370.356438:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a81b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096384:12345-0@lo:101: Request processed in 144us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.356445:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919370.356472:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004942f0be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978096256:0@lo:103: 00000100:00100000:3.0:1790919370.356498:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.356548:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096256 00000100:00100000:3.0:1790919370.356552:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096256 00000100:00100000:3.0:1790919370.356579:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919370.356585:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f221f008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:3458:x1877914978096256:12345-0@lo:103: 00010000:00010000:3.0:1790919370.356593:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919370.356605:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b22cde1a/0x951c50ad15913207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913200 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.356619:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919370.356719:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f221f008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:3458:x1877914978096256:12345-0@lo:103: Request processed in 134us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.356726:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919370.356974:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004942f0be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978096256:0@lo:103: 00000100:00100000:0.0:1790919370.357279:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096384:0@lo:101: 00010000:00010000:0.0:1790919370.357293:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.357299:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.357311:0:7234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790919370.357412:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.357420:0:7234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000009444514c/0x951c50ad1591321c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.357435:0:7234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790919370.357439:0:7234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919370.357444:0:7234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95f3b4712800 10000000:01000000:0.0:1790919370.357446:0:7234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790919370.357449:0:7234:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790919370.357452:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790919370.357471:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.357478:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.357485:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.357497:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096512:0@lo:101: 00000100:00100000:0.0:1790919370.357530:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.357562:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.357620:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096512 00000100:00100000:2.0:1790919370.357695:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096512 00000100:00100000:2.0:1790919370.357732:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919370.357738:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e8375d52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:7234:x1877914978096512:12345-0@lo:101: 00010000:00010000:2.0:1790919370.357834:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919370.357845:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591322a expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.357861:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591322a expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.357878:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591322a expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919370.357884:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd1723c9, rc 0) 00000100:00100000:2.0:1790919370.357923:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e8375d52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096512:12345-0@lo:101: Request processed in 186us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.357930:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919370.358446:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096512:0@lo:101: 00010000:00010000:0.0:1790919370.358458:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.358466:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.358559:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096640:0@lo:501: 00000100:00100000:0.0:1790919370.358593:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.358616:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.358830:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096640 00000100:00100000:2.0:1790919370.358837:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096640 00000100:00100000:2.0:1790919370.358874:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919370.358882:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003e89eec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096640:12345-0@lo:501: 00000100:00100000:2.0:1790919370.359337:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003e89eec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096640:12345-0@lo:501: Request processed in 455us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.359416:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790919370.359505:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096640:0@lo:501: 00000100:00100000:0.0:1790919370.359554:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096768:0@lo:503: 00000100:00100000:0.0:1790919370.359593:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.359623:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.359717:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096768 00000100:00100000:0.0:1790919370.359721:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096768 00000100:00100000:0.0:1790919370.359813:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919370.359821:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003ae08089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096768:12345-0@lo:503: 00000100:00100000:0.0:1790919370.359953:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003ae08089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096768:12345-0@lo:503: Request processed in 133us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.359960:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919370.359998:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096768:0@lo:503: 00000040:00080000:0.0:1790919370.360561:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919370.360886:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096896:0@lo:502: 00000100:00100000:0.0:1790919370.360933:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.361037:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.361279:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978096896 00000100:00100000:2.0:1790919370.361285:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978096896 00000100:00100000:3.0:1790919370.361489:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919370.361498:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008f8fc2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096896:12345-0@lo:502: 00000100:00100000:3.0:1790919370.361714:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008f8fc2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978096896:12345-0@lo:502: Request processed in 217us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.361722:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790919370.361800:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978096896:0@lo:502: 00000040:00080000:0.0:1790919370.362232:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790919370.362284:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1790919370.362328:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1790919370.362375:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1790919370.362408:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1790919370.362451:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1790919370.362485:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1790919370.362515:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1790919370.362574:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1790919370.362616:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1790919370.362837:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1790919370.362895:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1790919370.362931:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1790919370.362960:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1790919370.363003:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1790919370.363034:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1790919370.363161:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1790919370.363234:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1790919370.363283:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1790919370.363320:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1790919370.363682:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1790919370.363726:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1790919370.363758:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1790919370.363797:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978097024:0@lo:502: 00000100:00100000:0.0:1790919370.363870:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.367432:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fad7cc9 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.367559:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097024 00000100:00100000:1.0:1790919370.367569:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097024 00000100:00100000:1.0:1790919370.367613:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790919370.367726:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f74ee791 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978097024:12345-0@lo:502: 00000100:00100000:1.0:1790919370.368032:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f74ee791 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:7234:x1877914978097024:12345-0@lo:502: Request processed in 412us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.368041:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919370.368461:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978097024:0@lo:502: 00000040:00080000:0.0:1790919370.368612:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1790919370.368767:0:7234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1790919370.369568:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919370.369579:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.369587:0:7242:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790919370.369593:0:7242:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1790919370.369596:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919370.369608:0:7242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000297208a7) 00000020:00000080:1.0:1790919370.369752:0:7242:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1790919370.369760:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790919370.369842:0:7242:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790919370.369849:0:7242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad1591323f 00000020:00000080:1.0:1790919370.370290:0:7242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790919370.370295:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919370.370299:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.370300:0:7242:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790919370.370303:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919370.370307:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.370308:0:7242:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1790919370.370312:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919370.370319:0:7242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000dbe20528) 00000020:00000080:1.0:1790919370.370331:0:7242:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1790919370.370334:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790919370.370336:0:7242:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1790919370.370338:0:7242:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1790919370.370414:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790919370.370914:0:7242:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f93a7e85 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1790919370.370928:0:7242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000005d4c69e9) 00000020:00000080:1.0:1790919370.370937:0:7242:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1790919370.370998:0:7242:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790919370.371004:0:7242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15913254 00000020:00000080:1.0:1790919370.371268:0:7242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1790919370.371275:0:7242:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790919370.371280:0:7242:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x951c50ad1591325b 00080000:01000000:1.0:1790919370.371286:0:7242:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790919370.371290:0:7242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad15913262 00080000:10000000:1.0:1790919370.371912:0:7242:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1790919370.372428:0:7242:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1790919370.475469:0:7242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1790919370.475801:0:7242:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1790919370.480423:0:7242:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790919370.480795:0:7242:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 10000000:01000000:3.0:1790919370.601658:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790919370.601665:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f385571800 from 21 10000000:01000000:3.0:1790919370.601670:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919370.601706:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.601719:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919370.601729:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919370.601764:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097152:0@lo:101: 00000100:00100000:3.0:1790919370.601824:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.601876:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c57033 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.601954:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097152 00000100:00100000:1.0:1790919370.601962:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097152 00000100:00100000:1.0:1790919370.602983:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919370.602993:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003037b5df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6443:x1877914978097152:12345-0@lo:101: 00010000:00010000:1.0:1790919370.603016:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919370.603028:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913269 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.603062:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913269 expref: 13 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.603071:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913269 expref: 13 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.603079:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d8951bc, rc 0) 00000100:00100000:1.0:1790919370.603130:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003037b5df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978097152:12345-0@lo:101: Request processed in 139us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.603137:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919370.603492:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097152:0@lo:101: 00010000:00010000:1.0:1790919370.603563:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.603572:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.603638:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097280:0@lo:501: 00000100:00100000:1.0:1790919370.603669:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.603751:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9572f5 going to sleep for 11 seconds 00000100:00100000:3.0:1790919370.603792:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097280 00000100:00100000:3.0:1790919370.603798:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097280 00000100:00100000:3.0:1790919370.603867:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919370.603874:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006fc4a59c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978097280:12345-0@lo:501: 00000100:00100000:3.0:1790919370.604158:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006fc4a59c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978097280:12345-0@lo:501: Request processed in 285us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919370.604165:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919370.604227:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097280:0@lo:501: 00000100:00100000:1.0:1790919370.604257:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097408:0@lo:503: 00000100:00100000:1.0:1790919370.605266:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.605368:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9572f5 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.605391:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097408 00000100:00100000:1.0:1790919370.605396:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097408 00000100:00100000:1.0:1790919370.605432:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790919370.605453:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bea0bf63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978097408:12345-0@lo:503: 00000100:00100000:1.0:1790919370.605697:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bea0bf63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978097408:12345-0@lo:503: Request processed in 258us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.605704:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790919370.605823:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097408:0@lo:503: 00000100:00100000:3.0:1790919370.606444:0:7243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fa06eba pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7243:1877914978097536:0@lo:502: 00000100:00100000:3.0:1790919370.606491:0:7243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.609188:0:7243:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efe7b717 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.619970:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097536 00000100:00100000:1.0:1790919370.619985:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097536 00000100:00100000:1.0:1790919370.620205:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919370.620215:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005d128bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:7243:x1877914978097536:12345-0@lo:502: 00000100:00100000:1.0:1790919370.620495:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005d128bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:7243:x1877914978097536:12345-0@lo:502: Request processed in 281us (14003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.620517:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919370.620587:0:7243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fa06eba pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7243:1877914978097536:0@lo:502: 00000100:00100000:1.0:1790919370.620662:0:7243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7243:1877914978097664:0@lo:502: 00000100:00100000:1.0:1790919370.620703:0:7243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.620728:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097664 00000100:00100000:1.0:1790919370.620733:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097664 00000100:00100000:1.0:1790919370.620755:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919370.620769:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000029e47fb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:7243:x1877914978097664:12345-0@lo:502: 00000100:00100000:1.0:1790919370.620884:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000029e47fb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:7243:x1877914978097664:12345-0@lo:502: Request processed in 115us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.620891:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919370.620935:0:7243:0:(client.c:2716:ptlrpc_set_wait()) set 000000005abe3ec9 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.620947:0:7243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7243:1877914978097664:0@lo:502: 00000040:00080000:1.0:1790919370.620966:0:7243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790919370.621182:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790919370.621201:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919370.621209:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.621219:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919370.621228:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790919370.621231:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1790919370.621234:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919370.621256:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.621263:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.621272:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.621291:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097792:0@lo:101: 00000100:00100000:1.0:1790919370.621319:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.621340:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 000000005abe3ec9 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.621352:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097792 00000100:00100000:1.0:1790919370.621356:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097792 00000100:00100000:1.0:1790919370.621377:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919370.621382:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a5c0223c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978097792:12345-0@lo:101: 00010000:00010000:1.0:1790919370.621391:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919370.621401:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913277 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.621421:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913277 expref: 14 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.621430:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913277 expref: 14 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.621437:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004eaa1f29, rc 0) 00000100:00100000:1.0:1790919370.621466:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a5c0223c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978097792:12345-0@lo:101: Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.621472:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919370.621620:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097792:0@lo:101: 00010000:00010000:1.0:1790919370.622436:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.622447:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.622531:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097920:0@lo:501: 00000100:00100000:1.0:1790919370.622564:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.622585:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 000000005abe3ec9 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.622602:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978097920 00000100:00100000:1.0:1790919370.622606:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978097920 00000100:00100000:1.0:1790919370.622640:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919370.622647:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002f31ddb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978097920:12345-0@lo:501: 00000100:00100000:1.0:1790919370.622812:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002f31ddb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978097920:12345-0@lo:501: Request processed in 166us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.622818:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919370.622846:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978097920:0@lo:501: 00000100:00100000:1.0:1790919370.622868:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978098048:0@lo:503: 00000100:00100000:1.0:1790919370.622898:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.622910:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 000000005abe3ec9 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.622920:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098048 00000100:00100000:1.0:1790919370.622923:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098048 00000100:00100000:1.0:1790919370.622940:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790919370.622944:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004bafdbd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978098048:12345-0@lo:503: 00000100:00100000:1.0:1790919370.623212:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004bafdbd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978098048:12345-0@lo:503: Request processed in 266us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.623218:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919370.623239:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b63da27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978098048:0@lo:503: 00000100:00100000:2.0:1790919370.623618:0:7244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1e2fca7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7244:1877914978098176:0@lo:502: 00000100:00100000:2.0:1790919370.623666:0:7244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919370.623691:0:7244:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055482781 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.623914:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098176 00000100:00100000:1.0:1790919370.623919:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098176 00000100:00100000:1.0:1790919370.623943:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790919370.623949:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000039d7dec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:7244:x1877914978098176:12345-0@lo:502: 00000100:00100000:1.0:1790919370.624248:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000039d7dec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:7244:x1877914978098176:12345-0@lo:502: Request processed in 299us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.624256:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790919370.632800:0:7244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1e2fca7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7244:1877914978098176:0@lo:502: 00000020:01000000:1.0:1790919370.634706:0:7244:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919370.634721:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.634723:0:7244:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790919370.634730:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790919370.634736:0:7244:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:1.0:1790919370.634833:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919370.634867:0:7244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000d1d766dd) 00000020:00000080:1.0:1790919370.634889:0:7244:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790919370.634896:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790919370.634995:0:7244:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790919370.635000:0:7244:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790919370.635007:0:7244:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad1591328c 00010000:00080000:1.0:1790919370.635037:0:7244:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a215df93@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919370.640078:0:7244:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:3.0:1790919370.643688:0:7244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919370.643762:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790919370.643805:0:7244:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790919370.643826:0:7244:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15913293 00000100:00080000:3.0:1790919370.643835:0:7244:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919370.643845:0:7244:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a215df93 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919370.643876:0:7244:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000565cf5a4 x1877914978098304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919370.643895:0:7244:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1790919370.643926:0:7244:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1790919370.645655:0:7247:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000006818be41 x1877914978098432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919370.645670:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 0 seconds 00000020:01000000:3.0:1790919370.645734:0:7244:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919370.645741:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919370.645743:0:7244:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1790919370.645752:0:7244:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919370.645756:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919370.645758:0:7244:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790919370.645761:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790919370.645763:0:7244:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790919370.645785:0:7244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d65f6cf0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7244:1877914978098560:0@lo:502: 00000100:00100000:3.0:1790919370.645856:0:7244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.645900:0:7244:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086b28104 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.645926:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098560 00000100:00100000:1.0:1790919370.645933:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098560 00000100:00100000:1.0:1790919370.645974:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790919370.645982:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd889b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:7244:x1877914978098560:12345-0@lo:502: 00000100:00100000:1.0:1790919370.646383:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd889b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:7244:x1877914978098560:12345-0@lo:502: Request processed in 402us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.646391:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919370.646428:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978098688:0@lo:400: 00000100:00100000:1.0:1790919370.646451:0:7244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d65f6cf0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7244:1877914978098560:0@lo:502: 00000100:00100000:3.0:1790919370.646470:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1790919370.646476:0:7244:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919370.646482:0:7244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.646484:0:7244:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790919370.646494:0:7244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1790919370.646520:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098688 00000100:00100000:3.0:1790919370.646525:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098688 00000100:00100000:3.0:1790919370.646556:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919370.646563:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003cdd0d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978098688:12345-0@lo:400: 00000100:00100000:3.0:1790919370.646607:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003cdd0d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978098688:12345-0@lo:400: Request processed in 44us (137us total) trans 0 rc 0/0 00000020:01000000:1.0:1790919370.646610:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:3.0:1790919370.646616:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1790919370.646643:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790919370.646653:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646663:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919370.646672:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790919370.646675:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f3908ab380 from 1 10000000:01000000:1.0:1790919370.646677:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790919370.646700:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646708:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646715:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.646729:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000996a85fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978098816:0@lo:101: 00010000:00080000:3.0:1790919370.646751:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ff600f61 x1877914978098688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919370.646763:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff600f61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978098688:0@lo:400: 00000100:00100000:1.0:1790919370.646770:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.646794:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9b2a041 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.646811:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098816 00000100:00100000:1.0:1790919370.646814:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098816 00000100:00100000:1.0:1790919370.646835:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790919370.646850:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000027fdc1a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978098816:12345-0@lo:101: 00010000:00010000:1.0:1790919370.646858:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919370.646868:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591329a expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646893:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591329a expref: 15 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646901:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591329a expref: 15 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646908:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b414bd3f, rc 0) 00000100:00100000:1.0:1790919370.646938:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000027fdc1a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978098816:12345-0@lo:101: Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.646943:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790919370.646967:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000996a85fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978098816:0@lo:101: 00010000:00010000:1.0:1790919370.646976:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.646983:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.647024:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000996a85fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978098944:0@lo:501: 00000100:00100000:1.0:1790919370.647048:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.647084:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9b2a041 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.647095:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098944 00000100:00100000:1.0:1790919370.647107:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098944 00000100:00100000:1.0:1790919370.647131:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919370.647136:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006f52ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978098944:12345-0@lo:501: 00000100:00100000:3.0:1790919370.647469:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000565cf5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978098304:0@lo:38: 00000100:00100000:3.0:1790919370.647547:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.647598:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098304 00000100:00100000:3.0:1790919370.647602:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098304 00000100:00100000:1.0:1790919370.648082:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006f52ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978098944:12345-0@lo:501: Request processed in 945us (1032us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919370.648089:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790919370.648138:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919370.648144:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b71c25ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978098304:12345-0@lo:38: 00010000:02000000:3.0:1790919370.648160:0:6450:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:1.0:1790919370.648321:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000996a85fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978098944:0@lo:501: 10000000:01000000:1.0:1790919370.648352:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790919370.648358:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.648366:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919370.661553:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b71c25ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978098304:12345-0@lo:38: Request processed in 13403us (14001us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919370.661569:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790919370.661848:0:3457:0:(import.c:65:import_set_state_nolock()) 00000000a215df93 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919370.661854:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919370.661866:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000565cf5a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978098304:0@lo:38: 00000020:00000080:3.0:1790919370.687852:0:7242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790919370.687865:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919370.687871:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919370.687873:0:7242:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790919370.687877:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919370.687884:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919370.687885:0:7242:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790919370.687888:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919370.687893:0:7242:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1790919370.687921:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919370.687935:0:7242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000037eb8420) 00000020:00000080:3.0:1790919370.687957:0:7242:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:3.0:1790919370.687962:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919370.688021:0:7242:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790919370.688251:0:7242:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790919370.688261:0:7242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159132af 00010000:00080000:3.0:1790919370.688290:0:7242:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000094bab495@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919370.692750:0:7242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:1.0:1790919370.694401:0:7242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790919370.694414:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790919370.694442:0:7242:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790919370.694460:0:7242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159132b6 00000100:00080000:1.0:1790919370.694470:0:7242:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919370.694480:0:7242:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000094bab495 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919370.694511:0:7242:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000996a85fb x1877914978099072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919370.694541:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000996a85fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978099072:0@lo:38: 00000100:00100000:1.0:1790919370.694601:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919370.694674:0:7242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1790919370.694723:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919370.694728:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.694730:0:7242:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790919370.694733:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790919370.694735:0:7242:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790919370.694737:0:7242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790919370.694738:0:7242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790919370.694739:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790919370.694742:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.694743:0:7242:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790919370.694745:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919370.694756:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.694758:0:7242:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790919370.694763:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790919370.694793:0:7242:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790919370.694805:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919370.694808:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.694810:0:7242:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790919370.694812:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919370.694815:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.694816:0:7242:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790919370.694818:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790919370.694819:0:7242:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790919370.694900:0:7242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919370.694904:0:7242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919370.694905:0:7242:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790919370.694909:0:7242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1790919370.695280:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099072 00000100:00100000:0.0:1790919370.695290:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099072 00000100:00100000:0.0:1790919370.695328:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919370.695334:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ed60e14c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978099072:12345-0@lo:38: 00010000:00080000:0.0:1790919370.695419:0:6451:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1790919370.695453:0:6451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159132bd 00000004:00100000:0.0:1790919370.695466:0:6451:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790919370.695470:0:6451:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1790919370.695605:0:7234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1790919370.695664:0:7234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790919370.695685:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.695695:0:7234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.695703:0:7234:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4712800 from 1 10000000:01000000:0.0:1790919370.695706:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919370.695730:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.695736:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.695744:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.695759:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099200:0@lo:101: 00000100:00100000:0.0:1790919370.695804:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.695832:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000217fb2fd going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.695865:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099200 00000100:00100000:0.0:1790919370.695870:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099200 00000100:00100000:0.0:1790919370.695902:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919370.695908:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005584a065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:7234:x1877914978099200:12345-0@lo:101: 00010000:00010000:0.0:1790919370.695921:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919370.695932:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159132c4 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.695950:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159132c4 expref: 16 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.695966:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159132c4 expref: 16 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.695974:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000538f7c9, rc 0) 00000100:00100000:0.0:1790919370.696009:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005584a065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:7234:x1877914978099200:12345-0@lo:101: Request processed in 102us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.696015:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919370.697522:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099200:0@lo:101: 00010000:00010000:0.0:1790919370.697544:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.697554:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.699361:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099328:0@lo:256: 00000100:00100000:1.0:1790919370.699435:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.699471:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf8b41ce going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.699860:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099328 00000100:00100000:0.0:1790919370.699869:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099328 00000100:00100000:0.0:1790919370.699911:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919370.699918:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009782e5a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:7234:x1877914978099328:12345-0@lo:256: 20000000:01000000:0.0:1790919370.699938:0:6439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790919370.700965:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790919370.700971:0:6439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790919370.701257:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009782e5a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:7234:x1877914978099328:12345-0@lo:256: Request processed in 1339us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.701267:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919370.703247:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099328:0@lo:256: 10000000:01000000:1.0:1790919370.705016:0:7234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919370.705172:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.705187:0:7234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919370.705196:0:7234:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4712800 from 1 10000000:01000000:1.0:1790919370.705199:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919370.705232:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.705251:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.705261:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.705283:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099456:0@lo:101: 00000100:00100000:1.0:1790919370.706443:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.706492:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf8b41ce going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.707168:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099456 00000100:00100000:1.0:1790919370.707178:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099456 00000100:00100000:1.0:1790919370.707224:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919370.707232:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001e6d7ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:7234:x1877914978099456:12345-0@lo:101: 00010000:00010000:1.0:1790919370.707249:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919370.707265:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159132d2 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.707289:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159132d2 expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.707299:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159132d2 expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.707307:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bee5aa2d, rc 0) 00000100:00100000:1.0:1790919370.707443:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001e6d7ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:7234:x1877914978099456:12345-0@lo:101: Request processed in 212us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.707450:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919370.707500:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099456:0@lo:101: 00010000:00010000:1.0:1790919370.707525:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.707533:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919370.707765:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099584:0@lo:501: 00000100:00100000:1.0:1790919370.707796:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.707824:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf8b41ce going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.713166:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099584 00000100:00100000:1.0:1790919370.713178:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099584 00000100:00100000:1.0:1790919370.713222:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919370.713230:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d523ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:7234:x1877914978099584:12345-0@lo:501: 00000100:00100000:1.0:1790919370.713561:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d523ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:7234:x1877914978099584:12345-0@lo:501: Request processed in 332us (5764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.713570:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919370.713641:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099584:0@lo:501: 00000100:00100000:1.0:1790919370.713688:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099712:0@lo:503: 00000100:00100000:1.0:1790919370.713731:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.713758:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf8b41ce going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.713772:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099712 00000100:00100000:1.0:1790919370.713775:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099712 00000100:00100000:1.0:1790919370.713797:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790919370.713802:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d8612503 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:7234:x1877914978099712:12345-0@lo:503: 00000040:00080000:1.0:1790919370.713833:0:6438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919370.713868:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d8612503 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:7234:x1877914978099712:12345-0@lo:503: Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.713887:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790919370.713925:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099712:0@lo:503: 00000040:00080000:0.0:1790919370.716564:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919370.716613:0:7234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1790919370.716692:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919370.718000:0:7253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1790919370.718075:0:7234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790919370.718095:0:7234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919370.718108:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718120:0:7234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.718168:0:7234:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790919370.718171:0:7234:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3b4712800 10000000:01000000:0.0:1790919370.718174:0:7234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3b4712800 10000000:01000000:0.0:1790919370.718177:0:7234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919370.718182:0:7234:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3b4712800 from 1 10000000:01000000:0.0:1790919370.718184:0:7234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919370.718228:0:7234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718235:0:7234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718245:0:7234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.718267:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099840:0@lo:101: 00000100:00100000:0.0:1790919370.718327:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.718471:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099840 00000100:00100000:0.0:1790919370.718477:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099840 00000100:00100000:0.0:1790919370.718512:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919370.718519:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ebffc92a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:7234:x1877914978099840:12345-0@lo:101: 00010000:00010000:0.0:1790919370.718539:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919370.718550:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159132e0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718570:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159132e0 expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718578:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159132e0 expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718586:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f509f775, rc 0) 00000100:00100000:0.0:1790919370.718618:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ebffc92a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978099840:12345-0@lo:101: Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.718625:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919370.718677:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08b9027 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.718697:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099840:0@lo:101: 00010000:00010000:0.0:1790919370.718712:0:7234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.718720:0:7234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.718792:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099968:0@lo:501: 00000100:00100000:0.0:1790919370.718818:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.718840:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978099968 00000100:00100000:0.0:1790919370.718844:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978099968 00000100:00100000:0.0:1790919370.718864:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919370.718870:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000035b8364c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978099968:12345-0@lo:501: 00000100:00100000:0.0:1790919370.719199:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000035b8364c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978099968:12345-0@lo:501: Request processed in 328us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.719206:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919370.719229:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08b9027 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.719240:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978099968:0@lo:501: 00000100:00100000:0.0:1790919370.719264:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100096:0@lo:503: 00000100:00100000:0.0:1790919370.719297:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.719317:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100096 00000100:00100000:0.0:1790919370.719321:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100096 00000100:00100000:0.0:1790919370.719339:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790919370.719418:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000208d3cd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100096:12345-0@lo:503: 00000100:00100000:0.0:1790919370.719542:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000208d3cd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100096:12345-0@lo:503: Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.719548:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790919370.719578:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08b9027 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.719590:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100096:0@lo:503: 00000040:00080000:0.0:1790919370.719821:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919370.719869:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100224:0@lo:502: 00000100:00100000:0.0:1790919370.719901:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.719921:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100224 00000100:00100000:0.0:1790919370.719926:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100224 00000100:00100000:0.0:1790919370.719946:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919370.719952:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000091dfd8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100224:12345-0@lo:502: 00000100:00100000:0.0:1790919370.720534:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000091dfd8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100224:12345-0@lo:502: Request processed in 582us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.720552:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919370.720584:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08b9027 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.720597:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100224:0@lo:502: 00000040:00080000:0.0:1790919370.720836:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790919370.720884:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790919370.720921:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790919370.720971:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790919370.721010:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790919370.722986:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790919370.723189:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790919370.723228:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790919370.723281:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790919370.723317:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790919370.723429:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790919370.723481:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790919370.723516:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790919370.723547:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790919370.723594:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790919370.723643:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790919370.723677:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790919370.723724:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790919370.723760:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790919370.723794:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790919370.723840:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790919370.723874:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790919370.723928:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790919370.723981:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790919370.724018:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790919370.725585:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790919370.725677:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790919370.725715:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1790919370.725773:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100352:0@lo:502: 00000100:00100000:0.0:1790919370.725846:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.726536:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08b9027 going to sleep for 11 seconds 00000100:00100000:1.0:1790919370.727571:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100352 00000100:00100000:1.0:1790919370.727582:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100352 00000100:00100000:1.0:1790919370.727635:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790919370.727644:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004e7f2efe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100352:12345-0@lo:502: 00000100:00100000:1.0:1790919370.727871:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004e7f2efe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100352:12345-0@lo:502: Request processed in 228us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.727879:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790919370.729011:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100352:0@lo:502: 00000040:00080000:0.0:1790919370.729295:0:7234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790919370.729309:0:7234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790919370.731040:0:7254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790919370.731085:0:7254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000e54e5f4a) 00000020:00000080:0.0:1790919370.731107:0:7254:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:0.0:1790919370.731201:0:7254:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f93a7e85 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790919370.731205:0:7254:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f93a7e85 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790919370.731207:0:7254:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f93a7e85 3 00010000:00080000:0.0:1790919370.731235:0:7254:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fc4b414e@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919370.733725:0:7254:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:1.0:1790919370.733970:0:7254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790919370.734010:0:7254:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919370.734021:0:7254:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x951c50ad159132f5 00000100:00080000:1.0:1790919370.734039:0:7254:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919370.734094:0:7254:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000fc4b414e using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919370.734145:0:7254:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007363d8de x1877914978100480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919370.734175:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978100480:0@lo:38: 00000100:00100000:1.0:1790919370.734237:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919370.734286:0:7254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1790919370.736304:0:7254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1790919370.736369:0:7234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1790919370.736390:0:7234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919370.736403:0:7234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919370.736425:0:7234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919370.736466:0:7234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919370.736468:0:7234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919370.736469:0:7234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919370.736471:0:7234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919370.736472:0:7234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919370.736473:0:7234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919370.736475:0:7234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919370.736476:0:7234:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790919370.736477:0:7234:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790919370.736479:0:7234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919370.736480:0:7234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919370.736483:0:7234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1790919370.736485:0:7234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919370.736486:0:7234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919370.736487:0:7234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919370.736488:0:7234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919370.736489:0:7234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919370.736490:0:7234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919370.736491:0:7234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919370.736492:0:7234:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790919370.736493:0:7234:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790919370.736494:0:7234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919370.736495:0:7234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919370.736516:0:7234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790919370.736532:0:7234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031a459a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100608:0@lo:253: 00000100:00100000:1.0:1790919370.736604:0:7234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919370.736648:0:7234:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c57033 going to sleep for 11 seconds 40000000:00080000:3.0:1790919370.736860:0:7255:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1790919370.737981:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100480 00000100:00100000:0.0:1790919370.737992:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100480 00000100:00100000:0.0:1790919370.738030:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919370.738036:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d54f78ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978100480:12345-0@lo:38: 00010000:00080000:0.0:1790919370.738449:0:6446:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1790919370.738485:0:6446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x951c50ad159132fc 00000004:00100000:0.0:1790919370.738500:0:6446:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919370.738532:0:6446:0:(import.c:65:import_set_state_nolock()) 0000000064cdf16d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919370.738609:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d54f78ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1877914978100480:12345-0@lo:38: Request processed in 572us (4373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.738616:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919370.738692:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100608 00000100:00100000:0.0:1790919370.738696:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100608 00000100:00100000:0.0:1790919370.738723:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919370.738729:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004e880478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:7234:x1877914978100608:12345-0@lo:253: 20000000:01000000:0.0:1790919370.738760:0:6438:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790919370.738772:0:6438:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1790919370.741590:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007363d8de x1877914978100480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919370.741605:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919370.741616:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1790919370.741623:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790919370.741638:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919370.741641:0:3457:0:(import.c:65:import_set_state_nolock()) 00000000fc4b414e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919370.741648:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978100480:0@lo:38: 00000100:00080000:0.0:1790919370.754078:0:6451:0:(import.c:65:import_set_state_nolock()) 00000000956787fe : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919370.754171:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ed60e14c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978099072:12345-0@lo:38: Request processed in 58833us (59568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.754181:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919370.754238:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919370.754247:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1790919370.754254:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790919370.754259:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919370.754261:0:3457:0:(import.c:65:import_set_state_nolock()) 0000000094bab495 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919370.754273:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000996a85fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978099072:0@lo:38: 00000100:00100000:0.0:1790919370.754339:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978100736:0@lo:41: 00000100:00100000:0.0:1790919370.754382:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.754442:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100736 00000100:00100000:0.0:1790919370.754448:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100736 00000100:00100000:0.0:1790919370.754478:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919370.754485:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008a8764a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978100736:12345-0@lo:41: 00000004:00000024:0.0:1790919370.754521:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919370.754557:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008a8764a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978100736:12345-0@lo:41: Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.754563:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919370.754591:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978100736:0@lo:41: 20000000:01000000:3.0:1790919370.778124:0:6438:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790919370.778135:0:6438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1790919370.778562:0:6461:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790919370.778569:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790919370.778590:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.778609:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159131dd expref: 18 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.778616:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159132c4 expref: 18 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.778622:0:6461:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.778670:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159132c4 expref: 18 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.778682:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159132c4 expref: 18 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.778695:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978100864:0@lo:104: 00000100:00100000:0.0:1790919370.778757:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919370.778804:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159131dd expref: 18 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.778826:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159131dd expref: 18 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.778835:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978100992:0@lo:104: 00000100:00100000:0.0:1790919370.778858:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.778874:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a9eedaa going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.778899:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100864 00000100:00100000:0.0:1790919370.778906:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100864 00000100:00100000:0.0:1790919370.778938:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978100992 00000100:00100000:0.0:1790919370.778940:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978100992 00000100:00100000:0.0:1790919370.778953:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919370.778960:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006386855f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6461:x1877914978100864:12345-0@lo:104: 00010000:00010000:0.0:1790919370.778972:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779017:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919370.779035:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006386855f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6461:x1877914978100864:12345-0@lo:104: Request processed in 64us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.779164:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919370.779183:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919370.779189:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e4bfcf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978100992:12345-0@lo:104: 00010000:00010000:0.0:1790919370.779196:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779230:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790919370.779234:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e4bfcf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978100992:12345-0@lo:104: Request processed in 47us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.779252:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790919370.779274:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919370.779280:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779286:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000077c67a10 already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919370.779289:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779297:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919370.779304:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.779309:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919370.779335:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779411:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919370.779428:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779434:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000077c67a10/0x951c50ad159132c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132cb expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779445:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919370.779447:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779461:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b53e7ab9 already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919370.779463:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779468:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919370.779472:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919370.779477:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919370.779490:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779495:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919370.779508:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779513:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000b53e7ab9/0x951c50ad159131dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131e4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779524:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919370.779525:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919370.779527:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919370.779532:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919370.779547:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3a23ee7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978101120:0@lo:103: 00000100:00100000:0.0:1790919370.779575:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.779609:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a0ffa72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978101248:0@lo:103: 00000100:00100000:0.0:1790919370.779659:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.779692:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101120 00000100:00100000:0.0:1790919370.779696:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101120 00010000:00010000:0.0:1790919370.779711:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159132c4 expref: 19 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.779729:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101248 00000100:00100000:0.0:1790919370.779732:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101248 00010000:00010000:0.0:1790919370.779740:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159131dd expref: 20 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.779751:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919370.779756:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002860f2f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3461:x1877914978101120:12345-0@lo:103: 00010000:00010000:0.0:1790919370.779766:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919370.779769:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159132c4 expref: 20 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779777:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159132c4 expref: 20 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779790:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919370.779816:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002860f2f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3461:x1877914978101120:12345-0@lo:103: Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.779822:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919370.779833:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919370.779839:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000652c6e37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3458:x1877914978101248:12345-0@lo:103: 00010000:00010000:0.0:1790919370.779846:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919370.779849:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159131dd expref: 19 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779867:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159131dd expref: 19 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779879:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779886:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919370.779899:0:6430:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001330993s 00010000:00010000:0.0:1790919370.779902:0:6430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779908:0:6430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779914:0:6430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779920:0:6430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779925:0:6430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007f937fe7 already unused, calling callback (000000009f3081ad) 00010000:00010000:0.0:1790919370.779928:0:6430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779934:0:6430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779942:0:6430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.779961:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919370.779988:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000652c6e37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3458:x1877914978101248:12345-0@lo:103: Request processed in 150us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.779995:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919370.780428:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3a23ee7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978101120:0@lo:103: 00000100:00100000:0.0:1790919370.780455:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a0ffa72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978101248:0@lo:103: 00010000:00010000:0.0:1790919370.780475:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000538f7c9/0x951c50ad159132cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159132c4 expref: 18 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.780486:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a100377 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978100864:0@lo:104: 00010000:00010000:0.0:1790919370.780494:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000575e8b99/0x951c50ad159131e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159131dd expref: 17 pid: 6438 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919370.780503:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978100992:0@lo:104: 00010000:00010000:0.0:1790919370.780513:0:6461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.780521:0:6461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.780526:0:6461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919370.780531:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f937fe7/0x951c50ad15913303 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1790919370.816078:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790919370.819997:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004e880478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:7234:x1877914978100608:12345-0@lo:253: Request processed in 81260us (83386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.820013:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790919370.820265:0:7234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031a459a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:7234:1877914978100608:0@lo:253: 10000000:01000000:2.0:1790919370.820280:0:7234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790919370.820283:0:7234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919370.820286:0:7234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790919370.820287:0:7234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919370.820288:0:7234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919370.820290:0:7234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919370.820291:0:7234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919370.820292:0:7234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919370.820294:0:7234:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790919370.820295:0:7234:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790919370.820297:0:7234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919370.820298:0:7234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790919370.820312:0:7234:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790919370.826307:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919370.826783:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919370.826986:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919370.827196:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919370.827669:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919370.827875:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919370.828860:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919370.829303:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919370.829591:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919370.829768:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790919370.829951:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:3.0:1790919370.830339:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1790919370.832882:0:7234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1790919370.833463:0:7259:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790919370.833474:0:7259:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790919370.833549:0:7260:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1790919370.833596:0:7260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aae01335 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7260:1877914978101376:0@lo:700: 00000100:00100000:3.0:1790919370.833671:0:7260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919370.833743:0:7260:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcefe757 going to sleep for 11 seconds 00000040:01000000:1.0:1790919370.833782:0:7234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1790919370.834072:0:6452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101376 00000100:00100000:2.0:1790919370.834081:0:6452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101376 00000100:00100000:2.0:1790919370.834125:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919370.834133:0:6452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cdbb6373 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7260:x1877914978101376:12345-0@lo:700: 00000100:00100000:0.0:1790919370.835035:0:7261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978101504:0@lo:1000: 00000100:00100000:0.0:1790919370.835116:0:7261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.835156:0:7261:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc32d5f4 going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.835269:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101504 00000100:00100000:2.0:1790919370.835274:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101504 00000100:00100000:2.0:1790919370.835312:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919370.835319:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000a100377 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978101504:12345-0@lo:1000: 00000100:00100000:2.0:1790919370.835403:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000a100377 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978101504:12345-0@lo:1000: Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.835410:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919370.835590:0:7261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978101504:0@lo:1000: 00000040:01000000:0.0:1790919370.835617:0:7261:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1790919370.835651:0:7261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978101632:0@lo:700: 00000100:00100000:0.0:1790919370.835677:0:7261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.835701:0:7261:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c439f9ab going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.835754:0:6454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101632 00000100:00100000:2.0:1790919370.835758:0:6454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101632 00000100:00100000:2.0:1790919370.835789:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919370.835796:0:6454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a0ffa72 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978101632:12345-0@lo:700: 00000100:00100000:2.0:1790919370.835846:0:6454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a0ffa72 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978101632:12345-0@lo:700: Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.835852:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919370.835917:0:7261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978101632:0@lo:700: 00000100:00100000:0.0:1790919370.835951:0:7261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7261:1877914978101760:0@lo:900: 00000100:00100000:0.0:1790919370.835974:0:7261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.835998:0:7261:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c439f9ab going to sleep for 11 seconds 00000040:01000000:3.0:1790919370.836684:0:7234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1790919370.836872:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919370.837185:0:6456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101760 00000100:00100000:2.0:1790919370.837191:0:6456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101760 00000100:00100000:2.0:1790919370.837222:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919370.837230:0:6456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a23ee7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7261:x1877914978101760:12345-0@lo:900: 00000100:00100000:2.0:1790919370.837295:0:6456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a23ee7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7261:x1877914978101760:12345-0@lo:900: Request processed in 66us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919370.837302:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790919370.837454:0:7261:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000704e6fe4 x1877914978101760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919386 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919370.837466:0:7261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7261:1877914978101760:0@lo:900: 00000100:00100000:0.0:1790919370.837536:0:7261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978101888:0@lo:1000: 00000100:00100000:0.0:1790919370.837570:0:7261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.837595:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978101888 00000100:00100000:0.0:1790919370.837599:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978101888 00000100:00100000:0.0:1790919370.837623:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919370.837639:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ec932e25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978101888:12345-0@lo:1000: 00000100:00100000:0.0:1790919370.837693:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ec932e25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978101888:12345-0@lo:1000: Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.837699:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919370.837728:0:7261:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08b9027 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.837742:0:7261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978101888:0@lo:1000: 00000004:00080000:0.0:1790919370.837777:0:7261:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c439f9ab with version 0 00000020:00100000:0.0:1790919370.837790:0:7261:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790919370.837794:0:7261:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000704e6fe4 x1877914978102144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919370.837806:0:7261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978102144:0@lo:1000: 00000100:00100000:0.0:1790919370.837827:0:7261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.837844:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978102144 00000100:00100000:0.0:1790919370.837847:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978102144 00000100:00100000:0.0:1790919370.837867:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919370.837872:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002860f2f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978102144:12345-0@lo:1000: 00000100:00100000:0.0:1790919370.838913:0:7261:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2e385ed going to sleep for 11 seconds 00000004:00000080:3.0:1790919370.839592:0:7234:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790919370.839607:0:7234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1790919370.839832:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919370.841704:0:7234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790919370.842589:0:7234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790919370.842649:0:7234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1790919370.842897:0:7234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790919370.843287:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00100000:10000000:3.0:1790919370.844740:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790919370.844873:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790919370.845018:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790919370.845468:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790919370.845625:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790919370.845874:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790919370.846409:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790919370.846557:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790919370.846717:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790919370.846858:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790919370.847019:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790919370.847210:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790919370.847352:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790919370.847525:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790919370.847695:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790919370.847836:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790919370.848166:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790919370.848306:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790919370.848463:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790919370.848602:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790919370.848782:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790919370.848933:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790919370.849123:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790919370.849262:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790919370.849407:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790919370.849565:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790919370.857021:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790919370.857289:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790919370.857468:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790919370.857615:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790919370.857783:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790919370.857911:0:7234:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790919370.858125:0:7234:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1790919370.895838:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:1.0:1790919370.895868:0:6452:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1790919370.896473:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002860f2f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978102144:12345-0@lo:1000: Request processed in 58597us (58642us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790919370.896486:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1790919370.896537:0:7261:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1790919370.896542:0:7261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790919370.896555:0:7261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978102144:0@lo:1000: 00000100:00100000:0.0:1790919370.896654:0:7261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978102272:0@lo:1000: 00000100:00100000:0.0:1790919370.896689:0:7261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919370.896722:0:7261:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc32d5f4 going to sleep for 11 seconds 00000100:00100000:0.0:1790919370.896739:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978102272 00000100:00100000:0.0:1790919370.896745:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978102272 00000100:00100000:0.0:1790919370.896775:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919370.896782:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6dcb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978102272:12345-0@lo:1000: 00000100:00100000:0.0:1790919370.896866:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6dcb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7261:x1877914978102272:12345-0@lo:1000: Request processed in 83us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919370.896872:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919370.896896:0:7261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7261:1877914978102272:0@lo:1000: 00000040:00080000:0.0:1790919370.896911:0:7261:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1790919370.896934:0:7261:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c439f9ab with version 1 00000004:00080000:2.0:1790919370.897447:0:7251:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000059830f3b version 1 rpc_version 1 00000020:00100000:2.0:1790919370.897467:0:7251:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1790919370.897474:0:7251:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000033ee3ce2 x1877914978102528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919370.897489:0:7251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033ee3ce2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7251:1877914978102528:0@lo:1000: 00000100:00100000:2.0:1790919370.897526:0:7251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919370.897544:0:7251:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086b28104 going to sleep for 11 seconds 00000100:00100000:2.0:1790919370.897558:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978102528 00000100:00100000:2.0:1790919370.897562:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978102528 00000100:00100000:2.0:1790919370.897589:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919370.897595:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7251:x1877914978102528:12345-0@lo:1000: 00000040:00080000:0.0:1790919370.904926:0:7261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790919370.905004:0:7261:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1790919370.917465:0:6452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cdbb6373 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7260:x1877914978101376:12345-0@lo:700: Request processed in 83326us (83787us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919370.917485:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790919370.917606:0:7260:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aae01335 x1877914978101376/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790919386 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919370.917639:0:7260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aae01335 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7260:1877914978101376:0@lo:700: 40000000:02000000:3.0:1790919370.917651:0:7260:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1790919370.949839:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1790919370.951201:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7251:x1877914978102528:12345-0@lo:1000: Request processed in 53602us (53670us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790919370.951216:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1790919370.951265:0:7251:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1790919370.951269:0:7251:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790919370.951282:0:7251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033ee3ce2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7251:1877914978102528:0@lo:1000: 00000001:00080000:2.0:1790919370.957722:0:7234:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790919370.957760:0:7234:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa204c1c7f988 00100000:10000000:2.0:1790919370.957768:0:7234:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790919370.958323:0:7234:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919370.958370:0:7234:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919370.958384:0:7234:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790919370.958409:0:7234:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000040:00080000:3.0:1790919371.024797:0:7260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919371.079871:0:7260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790919371.079942:0:7260:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1790919371.079947:0:7260:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1790919371.170470:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919371.680202:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 0 seconds 00010000:00010000:0.0:1790919372.192233:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919372.702490:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 0 seconds 00010000:00010000:1.0:1790919373.212509:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919373.724305:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 0 seconds 00010000:00010000:0.0:1790919374.240899:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919374.751730:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 0 seconds 00000001:02000400:2.0:1790919374.791525:0:7504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790919375.260224:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919375.776002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790919375.776010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790919375.776013:0:8:0:(import.c:65:import_set_state_nolock()) 00000000a215df93 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919375.776022:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 179 00000100:00080000:0.0:1790919375.776027:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790919375.776037:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a215df93 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919375.776082:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000244a905e x1877914978102912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919375.776136:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978102656:0@lo:400: 00000100:00100000:0.0:1790919375.776215:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919375.776267:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919375.776273:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e92acb1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978103168:0@lo:400: 00000100:00100000:0.0:1790919375.776300:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919375.776331:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b438d42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978102784:0@lo:400: 00000100:00100000:0.0:1790919375.776373:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919375.776393:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919375.776398:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006541701c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978103040:0@lo:400: 00000100:00100000:0.0:1790919375.776421:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919375.776446:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000244a905e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978102912:0@lo:38: 00000100:00100000:0.0:1790919375.776490:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919375.776526:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978102656 00000100:00100000:0.0:1790919375.776533:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978102656 00000100:00100000:0.0:1790919375.776575:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919375.776582:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007a072548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3459:x1877914978102656:12345-0@lo:400: 00000100:00100000:0.0:1790919375.776644:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007a072548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3459:x1877914978102656:12345-0@lo:400: Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919375.776651:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919375.776680:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103168 00000100:00100000:0.0:1790919375.776683:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103168 00000100:00100000:0.0:1790919375.776704:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978102784 00000100:00100000:0.0:1790919375.776706:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978102784 00000100:00100000:0.0:1790919375.776719:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919375.776724:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008900e185 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978103168:12345-0@lo:400: 00000100:00100000:0.0:1790919375.776755:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008900e185 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978103168:12345-0@lo:400: Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919375.776761:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919375.776773:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919375.776779:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ff600f61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978102784:12345-0@lo:400: 00000100:00100000:0.0:1790919375.776810:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ff600f61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978102784:12345-0@lo:400: Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919375.776816:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790919375.776877:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003b438d42 x1877914978102784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919375.776890:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b438d42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978102784:0@lo:400: 00010000:00080000:0.0:1790919375.776920:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e92acb1c x1877914978103168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919375.776929:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e92acb1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978103168:0@lo:400: 00000100:00100000:0.0:1790919375.776936:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000704e6fe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978102656:0@lo:400: 00000100:00100000:0.0:1790919375.780687:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 0 seconds 00000100:00100000:1.0:1790919375.780933:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919375.780952:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000554cebae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978103296:0@lo:41: 00000100:00100000:1.0:1790919375.781017:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919375.781145:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103040 00000100:00100000:2.0:1790919375.781153:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103040 00000100:00100000:2.0:1790919375.781190:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978102912 00000100:00100000:2.0:1790919375.781204:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978102912 00000100:00100000:2.0:1790919375.781215:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103296 00000100:00100000:2.0:1790919375.781217:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103296 00000100:00100000:2.0:1790919375.781230:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919375.781237:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000563b57f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978103040:12345-0@lo:400: 00000100:00100000:2.0:1790919375.781312:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000563b57f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978103040:12345-0@lo:400: Request processed in 76us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919375.781320:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919375.781337:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919375.781341:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c8e4a3cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978102912:12345-0@lo:38: 00010000:00080000:2.0:1790919375.781364:0:6450:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1790919375.781396:0:6450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591330a 00000004:00100000:2.0:1790919375.781413:0:6450:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790919375.781418:0:6450:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1790919375.781698:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006541701c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978103040:0@lo:400: 00000100:00080000:2.0:1790919375.820865:0:6450:0:(import.c:65:import_set_state_nolock()) 0000000024a8acc8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919375.820967:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c8e4a3cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978102912:12345-0@lo:38: Request processed in 39623us (44476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919375.820986:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919375.821017:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919375.821027:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bab8a7c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978103296:12345-0@lo:41: 00000100:00100000:3.0:1790919375.821036:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919375.821045:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790919375.821077:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790919375.821083:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000004:00000024:2.0:1790919375.821084:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00080000:3.0:1790919375.821085:0:3457:0:(import.c:65:import_set_state_nolock()) 00000000a215df93 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1790919375.821099:0:3457:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009637243c): req@000000006818be41 x1877914978098432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919375.821116:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000244a905e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978102912:0@lo:38: 00000100:00100000:2.0:1790919375.821119:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bab8a7c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978103296:12345-0@lo:41: Request processed in 97us (40103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919375.821125:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919375.821186:0:7247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919375.821225:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000009637243c going to sleep for 11 seconds 00000100:00100000:3.0:1790919375.821240:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978098432 00000100:00100000:3.0:1790919375.821245:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978098432 00000100:00100000:3.0:1790919375.821277:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919375.821282:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000aae01335 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978098432:12345-0@lo:1000: 00000100:00100000:3.0:1790919375.821344:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000aae01335 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978098432:12345-0@lo:1000: Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919375.821350:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919375.821376:0:7247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006818be41 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978098432:0@lo:1000: 00000040:01000000:3.0:1790919375.821413:0:7247:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790919375.821449:0:7247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103424:0@lo:1000: 00000100:00100000:3.0:1790919375.821477:0:7247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919375.821496:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 00000000785f3825 going to sleep for 11 seconds 00000100:00100000:3.0:1790919375.821507:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103424 00000100:00100000:3.0:1790919375.821510:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103424 00000100:00100000:3.0:1790919375.821526:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919375.821530:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f221f008 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103424:12345-0@lo:1000: 00000100:00100000:3.0:1790919375.821650:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f221f008 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103424:12345-0@lo:1000: Request processed in 120us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919375.821656:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919375.821679:0:7247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103424:0@lo:1000: 00000100:00100000:3.0:1790919375.821714:0:7247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103552:0@lo:700: 00000100:00100000:3.0:1790919375.821738:0:7247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919375.821761:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f47d123 going to sleep for 11 seconds 00000100:00100000:2.0:1790919375.821836:0:6454:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103552 00000100:00100000:2.0:1790919375.821840:0:6454:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103552 00000100:00100000:2.0:1790919375.821874:0:6454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919375.821881:0:6454:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000565cf5a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103552:12345-0@lo:700: 00000100:00100000:2.0:1790919375.821922:0:6454:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000565cf5a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103552:12345-0@lo:700: Request processed in 42us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919375.821928:0:6454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919375.823415:0:7247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103552:0@lo:700: 00000100:00100000:3.0:1790919375.823540:0:7247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103680:0@lo:1000: 00000100:00100000:3.0:1790919375.823586:0:7247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919375.823620:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 000000004bb3beed going to sleep for 11 seconds 00000100:00100000:3.0:1790919375.823696:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103680 00000100:00100000:3.0:1790919375.823701:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103680 00000100:00100000:3.0:1790919375.823745:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919375.823753:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d65f6cf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103680:12345-0@lo:1000: 00000100:00100000:3.0:1790919375.823822:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d65f6cf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103680:12345-0@lo:1000: Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919375.823830:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919375.823865:0:7247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103680:0@lo:1000: 00000004:00080000:3.0:1790919375.823905:0:7247:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000007f47d123 with version 0 00000020:00100000:3.0:1790919375.823917:0:7247:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790919375.823923:0:7247:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000092caef1d x1877914978103936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919375.823936:0:7247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103936:0@lo:1000: 00000100:00100000:1.0:1790919375.824435:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000554cebae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978103296:0@lo:41: 00000100:00100000:1.0:1790919375.824455:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919375.824462:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006818be41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978104064:0@lo:41: 00000100:00100000:3.0:1790919375.825311:0:7247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919375.825394:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978103936 00000100:00100000:2.0:1790919375.825400:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978103936 00000100:00100000:2.0:1790919375.825438:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919375.825445:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009fa06eba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7247:x1877914978103936:12345-0@lo:1000: 00000100:00100000:1.0:1790919375.827451:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919375.828115:0:6451:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1790919375.828126:0:6451:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1790919375.828968:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070090f9d going to sleep for 11 seconds 00000100:00100000:2.0:1790919375.838792:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104064 00000100:00100000:2.0:1790919375.838805:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104064 00000100:00100000:2.0:1790919375.838934:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919375.838942:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000554cebae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3461:x1877914978104064:12345-0@lo:41: 00000004:00000024:2.0:1790919375.838985:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919375.856390:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000554cebae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3461:x1877914978104064:12345-0@lo:41: Request processed in 17439us (29003us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919375.856421:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919375.856505:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006818be41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978104064:0@lo:41: 00000001:00080000:0.0:1790919375.888897:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1790919375.888913:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790919375.889316:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009fa06eba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7247:x1877914978103936:12345-0@lo:1000: Request processed in 63867us (64004us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790919375.889333:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1790919375.889469:0:7247:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1790919375.889474:0:7247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790919375.889489:0:7247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092caef1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978103936:0@lo:1000: 00000100:00100000:2.0:1790919375.889573:0:7247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033ee3ce2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978104192:0@lo:1000: 00000100:00100000:2.0:1790919375.889623:0:7247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919375.889722:0:7247:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047d470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919375.889777:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104192 00000100:00100000:0.0:1790919375.889783:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104192 00000100:00100000:0.0:1790919375.889859:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919375.889867:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d9aca8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7247:x1877914978104192:12345-0@lo:1000: 00000100:00100000:0.0:1790919375.889948:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d9aca8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7247:x1877914978104192:12345-0@lo:1000: Request processed in 83us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919375.889955:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790919375.890007:0:7247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033ee3ce2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7247:1877914978104192:0@lo:1000: 00000040:00080000:1.0:1790919375.890027:0:7247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1790919375.890078:0:7247:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005bfbff63 with version 1 00000004:00080000:2.0:1790919375.890122:0:7245:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003e130ca8 version 1 rpc_version 1 00000020:00100000:2.0:1790919375.890140:0:7245:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1790919375.890147:0:7245:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a7de5357 x1877914978104448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919375.890160:0:7245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7de5357 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7245:1877914978104448:0@lo:1000: 00000100:00100000:2.0:1790919375.890185:0:7245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919375.890199:0:7245:0:(client.c:2716:ptlrpc_set_wait()) set 00000000139e1823 going to sleep for 11 seconds 00000100:00100000:0.0:1790919375.890243:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104448 00000100:00100000:0.0:1790919375.890246:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104448 00000100:00100000:0.0:1790919375.890298:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919375.890304:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006497468f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7245:x1877914978104448:12345-0@lo:1000: 00000040:00080000:1.0:1790919375.892154:0:7247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790919375.892217:0:7247:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 5, retries 0 00000004:00080000:1.0:1790919375.892221:0:7247:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1790919375.950562:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006497468f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7245:x1877914978104448:12345-0@lo:1000: Request processed in 60251us (60369us total) trans 4294967298 rc 0/0 00000001:00080000:3.0:1790919375.950570:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1790919375.950599:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919375.950695:0:7245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7de5357 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7245:1877914978104448:0@lo:1000: 00010000:00010000:0.0:1790919376.284422:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790919377.308212:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790919377.308221:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4712800 from 4 10000000:01000000:0.0:1790919377.308225:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919377.308283:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919377.308295:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919377.308305:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919377.308328:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ca9531b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104576:0@lo:101: 00010000:00010000:1.0:1790919377.308337:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919377.308415:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919377.308465:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104576 00000100:00100000:0.0:1790919377.308470:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3be0058 going to sleep for 11 seconds 00000100:00100000:1.0:1790919377.308475:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104576 00000100:00100000:1.0:1790919377.308525:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919377.308534:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000014b81619 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978104576:12345-0@lo:101: 00010000:00010000:1.0:1790919377.308573:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919377.308596:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ae88e73/0x951c50ad15913318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913311 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919377.308619:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ae88e73/0x951c50ad15913318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913311 expref: 17 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919377.308629:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ae88e73/0x951c50ad15913318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913311 expref: 17 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919377.308637:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ae88e73, rc 0) 00000100:00100000:1.0:1790919377.308708:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000014b81619 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978104576:12345-0@lo:101: Request processed in 175us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919377.308716:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790919377.308812:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ca9531b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104576:0@lo:101: 00010000:00010000:2.0:1790919377.308827:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919377.308834:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919377.308883:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030207f9d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104704:0@lo:256: 00000100:00100000:2.0:1790919377.308925:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919377.308954:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f674211e going to sleep for 11 seconds 00000100:00100000:0.0:1790919377.309072:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104704 00000100:00100000:0.0:1790919377.309077:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104704 00000100:00100000:0.0:1790919377.309110:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790919377.309129:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004eb4383e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978104704:12345-0@lo:256: 20000000:01000000:0.0:1790919377.309145:0:6440:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919377.309160:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919377.309163:0:6440:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1790919377.309267:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004eb4383e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978104704:12345-0@lo:256: Request processed in 150us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919377.309276:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790919377.309291:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030207f9d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104704:0@lo:256: 10000000:01000000:3.0:1790919377.309342:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790919377.309348:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919377.309355:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000020141ec2/0x951c50ad15913311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919377.309364:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790919377.309366:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f385571800 from 4 10000000:01000000:3.0:1790919377.309368:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790919377.309384:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919377.309391:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919377.309397:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919377.309417:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104832:0@lo:101: 00000100:00100000:3.0:1790919377.309445:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919377.309477:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a00dc84 going to sleep for 11 seconds 00000100:00100000:1.0:1790919377.309610:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104832 00000100:00100000:1.0:1790919377.309616:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104832 00000100:00100000:1.0:1790919377.309646:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790919377.309651:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000023be2e8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978104832:12345-0@lo:101: 00010000:00010000:1.0:1790919377.309659:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919377.309668:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a02cf3ee/0x951c50ad15913326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591331f expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919377.309683:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a02cf3ee/0x951c50ad15913326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591331f expref: 18 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919377.309692:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a02cf3ee/0x951c50ad15913326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591331f expref: 18 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919377.309699:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a02cf3ee, rc 0) 00000100:00100000:1.0:1790919377.309748:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000023be2e8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978104832:12345-0@lo:101: Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919377.309754:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790919377.310141:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104832:0@lo:101: 00010000:00010000:3.0:1790919377.310153:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919377.310160:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919377.310206:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104960:0@lo:256: 00000100:00100000:3.0:1790919377.310236:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919377.310264:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a00dc84 going to sleep for 11 seconds 00000100:00100000:0.0:1790919377.310285:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978104960 00000100:00100000:0.0:1790919377.310291:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978104960 00000100:00100000:0.0:1790919377.310330:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790919377.310336:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004888171e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978104960:12345-0@lo:256: 20000000:01000000:0.0:1790919377.310349:0:6440:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919377.310361:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919377.310364:0:6440:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1790919377.310450:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004888171e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978104960:12345-0@lo:256: Request processed in 113us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919377.310452:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978104960:0@lo:256: 00000100:00100000:0.0:1790919377.310464:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 10000000:01000000:3.0:1790919377.310501:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790919377.310506:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919377.310513:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000575e8b99/0x951c50ad1591331f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919378.332828:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790919379.322988:0:7707:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe843923d0 20000000:00000080:1.0:1790919379.323004:0:7707:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f3be3a9000 uarg=0000000000000000 20000000:01000000:1.0:1790919379.323034:0:7707:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790919379.323041:0:7707:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790919379.323046:0:7707:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790919379.323335:0:7707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790919379.323348:0:7707:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790919379.329196:0:7707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919379.329663:0:7707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790919379.329728:0:7707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790919379.329795:0:7707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790919379.329818:0:7707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790919379.329835:0:7707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.329853:0:7707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159131a5 expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.329940:0:7707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159132d2 expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.329949:0:7707:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.330083:0:7707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159132d2 expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.330100:0:7707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159132d2 expref: 17 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.330128:0:7707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031a459a0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7707:1877914978105088:0@lo:104: 00000100:00100000:1.0:1790919379.330194:0:7707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919379.330248:0:7707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159131a5 expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919379.330349:0:6429:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790919379.330367:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105088 00000100:00100000:0.0:1790919379.330375:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105088 00010000:00010000:1.0:1790919379.330405:0:7707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159131a5 expref: 17 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.330416:0:7707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d471725e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7707:1877914978105216:0@lo:104: 00000100:00100000:0.0:1790919379.330426:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919379.330436:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000026a7f9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:7707:x1877914978105088:12345-0@lo:104: 00000100:00100000:1.0:1790919379.330447:0:7707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919379.330448:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.330461:0:7707:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009f0a0db going to sleep for 11 seconds 00010000:00010000:0.0:1790919379.330525:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919379.330532:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000026a7f9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:7707:x1877914978105088:12345-0@lo:104: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919379.330539:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919379.330549:0:7707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031a459a0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7707:1877914978105088:0@lo:104: 00000100:00100000:0.0:1790919379.330599:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105216 00000100:00100000:0.0:1790919379.330604:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105216 00010000:00010000:3.0:1790919379.330619:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790919379.330624:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1790919379.330627:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919379.330632:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000996a85fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:7707:x1877914978105216:12345-0@lo:104: 00010000:00010000:3.0:1790919379.330643:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f74c57fb already unused, calling callback (000000009d3db3fa) 00010000:00010000:0.0:1790919379.330644:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919379.330655:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919379.330665:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919379.330673:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919379.330679:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919379.330698:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1790919379.330711:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919379.330711:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000996a85fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:7707:x1877914978105216:12345-0@lo:104: Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919379.330727:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1790919379.330728:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919379.330747:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919379.330751:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919379.330759:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000f74c57fb/0x951c50ad159132d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132d9 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919379.330772:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919379.330774:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919379.330776:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919379.330797:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978105344:0@lo:103: 00000100:00100000:3.0:1790919379.330831:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919379.330881:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919379.330886:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.330893:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000059a5d1f8 already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919379.330896:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.330902:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919379.330908:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919379.330912:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919379.330931:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.330937:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919379.330960:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.330967:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000059a5d1f8/0x951c50ad159131a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159131ac expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.330980:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919379.330982:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919379.330990:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919379.330994:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919379.330996:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919379.331014:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b5b0191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978105472:0@lo:103: 00000100:00100000:1.0:1790919379.331036:0:7707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d471725e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7707:1877914978105216:0@lo:104: 00000100:00100000:0.0:1790919379.331044:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919379.331092:0:7707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.331130:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105344 00000100:00100000:1.0:1790919379.331135:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105344 00010000:00010000:1.0:1790919379.331149:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159132d2 expref: 18 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.331169:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105472 00000100:00100000:1.0:1790919379.331172:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105472 00010000:00010000:1.0:1790919379.331182:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159131a5 expref: 19 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.331197:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919379.331203:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d313bf61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3461:x1877914978105344:12345-0@lo:103: 00010000:00010000:1.0:1790919379.331219:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919379.331224:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159132d2 expref: 19 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.331233:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159132d2 expref: 19 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919379.331244:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bee5aa2d/0x951c50ad159132d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159132d2 expref: 19 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919379.331421:0:6432:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790919379.331428:0:6432:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1790919379.331482:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919379.331732:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919379.331741:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fcdf3068 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:3458:x1877914978105472:12345-0@lo:103: 00010000:00010000:2.0:1790919379.331751:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919379.331755:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159131a5 expref: 18 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331765:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159131a5 expref: 18 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331775:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009cb374c0/0x951c50ad159131ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159131a5 expref: 18 pid: 6440 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331787:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331793:0:6432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331805:0:6432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331811:0:6432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331817:0:6432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331823:0:6432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331828:0:6432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b53e7ab9 already unused, calling callback (000000009f3081ad) 00010000:00010000:2.0:1790919379.331837:0:6432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331844:0:6432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331857:0:6432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919379.331866:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919379.331961:0:7707:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.331969:0:7707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919379.331974:0:7707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b53e7ab9/0x951c50ad1591332d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919379.332603:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d313bf61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3461:x1877914978105344:12345-0@lo:103: Request processed in 1398us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919379.332611:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919379.332675:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978105344:0@lo:103: 00000100:00100000:2.0:1790919379.336845:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fcdf3068 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3458:x1877914978105472:12345-0@lo:103: Request processed in 5100us (5796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919379.336861:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919379.338322:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b5b0191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978105472:0@lo:103: 00010000:00010000:3.0:1790919379.358454:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919380.380484:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919380.892897:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919380.892922:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b5b0191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978105600:0@lo:41: 00000100:00100000:0.0:1790919380.892989:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919380.893238:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105600 00000100:00100000:2.0:1790919380.893251:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105600 00000100:00100000:2.0:1790919380.893307:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919380.893314:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000063c7c160 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978105600:12345-0@lo:41: 00000004:00000024:2.0:1790919380.893370:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919380.893444:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000063c7c160 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978105600:12345-0@lo:41: Request processed in 130us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919380.893452:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919380.893483:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003220c1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978105728:0@lo:400: 00000100:00100000:2.0:1790919380.893522:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919380.893580:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919380.893586:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047d09f24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978105856:0@lo:400: 00000100:00100000:2.0:1790919380.893617:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919380.893669:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105728 00000100:00100000:2.0:1790919380.893673:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105728 00000100:00100000:2.0:1790919380.893704:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790919380.893716:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edcb33a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978106112:0@lo:400: 00000100:00100000:2.0:1790919380.893737:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004ae370d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3460:x1877914978105728:12345-0@lo:400: 00000100:00100000:1.0:1790919380.893777:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919380.893843:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105856 00000100:00100000:3.0:1790919380.893862:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105856 00000100:00100000:3.0:1790919380.893901:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106112 00000100:00100000:3.0:1790919380.893904:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106112 00000100:00100000:3.0:1790919380.893919:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790919380.893925:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000058b52468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978105856:12345-0@lo:400: 00000100:00100000:2.0:1790919380.894109:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004ae370d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3460:x1877914978105728:12345-0@lo:400: Request processed in 375us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919380.894118:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790919380.894166:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032457f71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978105984:0@lo:400: 00000100:00100000:2.0:1790919380.894200:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919380.894239:0:3458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000004:00080000:2.0:1790919380.894247:0:3458:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1790919380.894276:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b5b0191 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978105600:0@lo:41: 00000100:00100000:2.0:1790919380.894308:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978105984 00000100:00100000:2.0:1790919380.894312:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978105984 00000100:00100000:2.0:1790919380.894352:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919380.894359:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005d009f90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978105984:12345-0@lo:400: 00000100:00100000:2.0:1790919380.894422:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005d009f90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978105984:12345-0@lo:400: Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919380.894428:0:6446:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790919380.894430:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790919380.894444:0:6446:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790919380.894475:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003220c1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978105728:0@lo:400: 00000100:00100000:1.0:1790919380.894622:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919380.894632:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d471725e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978106112:12345-0@lo:400: 00000100:00100000:1.0:1790919380.894694:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d471725e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978106112:12345-0@lo:400: Request processed in 64us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919380.894702:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790919380.894750:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000edcb33a7 x1877914978106112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919380.894760:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032457f71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978105984:0@lo:400: 00000100:00100000:1.0:1790919380.894769:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edcb33a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978106112:0@lo:400: 00000100:00100000:3.0:1790919380.896870:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000058b52468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978105856:12345-0@lo:400: Request processed in 2937us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919380.896884:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919380.897746:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a6f6e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978106240:0@lo:41: 00000100:00100000:1.0:1790919380.897808:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790919380.897862:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000047d09f24 x1877914978105856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919380.897876:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047d09f24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978105856:0@lo:400: 00000100:00100000:0.0:1790919380.902338:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106240 00000100:00100000:0.0:1790919380.902353:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106240 00000100:00100000:0.0:1790919380.902416:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919380.902426:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000031a459a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978106240:12345-0@lo:41: 00000004:00000024:0.0:1790919380.902468:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919380.904356:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000031a459a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978106240:12345-0@lo:41: Request processed in 1588us (6205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919380.904370:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919380.904829:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a6f6e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978106240:0@lo:41: 00010000:00010000:1.0:1790919381.405193:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919382.428274:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919383.452225:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919383.990474:0:8080:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790919383.990478:0:8080:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790919383.990687:0:8080:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c229e8a1 00000020:01000004:0.0:1790919383.990702:0:8080:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790919383.990715:0:8080:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790919383.990735:0:8080:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000007a20a123) 00000020:00000080:0.0:1790919383.990751:0:8080:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790919384.004486:0:8080:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790919384.004838:0:8080:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790919384.028951:0:8080:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790919384.036425:0:8080:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790919384.036459:0:8080:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790919384.036519:0:8080:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790919384.036559:0:8080:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790919384.040392:0:8080:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790919384.040405:0:8080:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790919384.040416:0:8080:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x951c50ad1591333b 00000020:01000004:1.0:1790919384.040422:0:8080:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1790919384.040445:0:8080:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790919384.040448:0:8080:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790919384.040453:0:8080:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790919384.040457:0:8080:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790919384.040467:0:8080:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000052df2ca6) 00000020:00000080:1.0:1790919384.040478:0:8080:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1790919384.042081:0:8080:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919384.042234:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790919384.042240:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790919384.047627:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790919384.047639:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790919384.048021:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790919384.048027:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790919384.049357:0:8080:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919384.049552:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790919384.049558:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790919384.055132:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790919384.055147:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790919384.079810:0:8080:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919384.081279:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790919384.081290:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790919384.084714:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790919384.084729:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790919384.085562:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790919384.085570:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790919384.092875:0:8080:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919384.095107:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790919384.095117:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790919384.103396:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790919384.103414:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790919384.183114:0:8080:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919384.183347:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790919384.183361:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790919384.189368:0:8080:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790919384.189451:0:8080:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790919384.192789:0:8080:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790919384.192821:0:8080:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790919384.192827:0:8080:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790919384.224300:0:8080:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790919384.224342:0:8080:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1790919384.224346:0:8080:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790919384.224348:0:8080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919384.224349:0:8080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919384.224351:0:8080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919384.224352:0:8080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919384.224353:0:8080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919384.224355:0:8080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919384.224356:0:8080:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919384.224362:0:8080:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919384.224364:0:8080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919384.224365:0:8080:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919384.224368:0:8080:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1790919384.224371:0:8080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919384.224372:0:8080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790919384.224372:0:8080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919384.224373:0:8080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919384.224374:0:8080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919384.224375:0:8080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919384.224376:0:8080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919384.224376:0:8080:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919384.224377:0:8080:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919384.224378:0:8080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919384.224379:0:8080:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919384.224403:0:8080:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790919384.224419:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978106368:0@lo:253: 00000100:00100000:3.0:1790919384.224489:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919384.224548:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dea0679c going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.224799:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106368 00000100:00100000:2.0:1790919384.224808:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106368 00000100:00100000:2.0:1790919384.224866:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790919384.224875:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002208b8f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:8080:x1877914978106368:12345-0@lo:253: 20000000:01000000:2.0:1790919384.224916:0:6439:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790919384.224921:0:6439:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1790919384.224936:0:6439:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1790919384.224939:0:6439:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1790919384.225834:0:6439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919384.226027:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1790919384.226041:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1790919384.226105:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1790919384.226113:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1790919384.226145:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1790919384.226208:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1790919384.226564:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1790919384.226582:0:6439:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1790919384.226584:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1790919384.226619:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1790919384.226627:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790919384.226674:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1790919384.226682:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1790919384.226715:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1790919384.226724:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790919384.226770:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1790919384.226826:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1790919384.227204:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1790919384.227218:0:6439:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1790919384.227219:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1790919384.227251:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1790919384.227267:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790919384.227313:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1790919384.227321:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1790919384.227350:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1790919384.227358:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790919384.227386:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1790919384.227458:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1790919384.228147:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1790919384.228164:0:6439:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1790919384.228166:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1790919384.228193:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1790919384.228200:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790919384.228229:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1790919384.228241:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1790919384.228268:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1790919384.228275:0:6439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790919384.228310:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1790919384.228341:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1790919384.228355:0:6439:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1790919384.228357:0:6439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1790919384.228362:0:6439:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790919384.228364:0:6439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790919384.228366:0:6439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790919384.228377:0:6439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790919384.228379:0:6439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790919384.228408:0:6439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790919384.228410:0:6439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790919384.232510:0:8095:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1790919384.232612:0:8095:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1790919384.232672:0:8095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790919384.233384:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790919384.233432:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790919384.233524:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790919384.233553:0:6439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790919384.233556:0:6439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790919384.234301:0:8096:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1790919384.234356:0:8096:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1790919384.234405:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790919384.234659:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1790919384.234702:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1790919384.234740:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1790919384.234752:0:6439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790919384.234754:0:6439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790919384.235296:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790919384.235614:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790919384.235656:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790919384.235713:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790919384.235725:0:6439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790919384.235727:0:6439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919384.236583:0:8098:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919384.236641:0:8098:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919384.236697:0:8098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1790919384.237307:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1790919384.237349:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1790919384.237409:0:6439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1790919384.237428:0:6439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790919384.237446:0:6439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237462:0:6439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591322a expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237470:0:6439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913269 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237476:0:6439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913277 expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237481:0:6439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591329a expref: 16 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237487:0:6439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159132e0 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237494:0:6439:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237545:0:6439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159132e0 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237560:0:6439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159132e0 expref: 16 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919384.237573:0:6439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032457f71 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978106496:0@lo:104: 00000100:00100000:2.0:1790919384.237632:0:6439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919384.237723:0:6439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591329a expref: 16 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237731:0:6439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591329a expref: 16 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919384.237738:0:6439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7de5357 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978106624:0@lo:104: 00000100:00100000:2.0:1790919384.237759:0:6439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919384.237835:0:6439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913277 expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.237841:0:6439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913277 expref: 16 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919384.237849:0:6439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f4a3b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978106752:0@lo:104: 00000100:00100000:2.0:1790919384.238036:0:6439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.238179:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106496 00000100:00100000:0.0:1790919384.238187:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106496 00000100:00100000:0.0:1790919384.238221:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106624 00000100:00100000:0.0:1790919384.238224:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106624 00000100:00100000:0.0:1790919384.238238:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919384.238245:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000003220c1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6439:x1877914978106496:12345-0@lo:104: 00010000:00010000:0.0:1790919384.238257:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238308:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919384.238314:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000003220c1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6439:x1877914978106496:12345-0@lo:104: Request processed in 70us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.238320:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919384.238335:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919384.238340:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000078f87c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6439:x1877914978106624:12345-0@lo:104: 00010000:00010000:0.0:1790919384.238354:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238386:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790919384.238390:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000078f87c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6439:x1877914978106624:12345-0@lo:104: Request processed in 50us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.238395:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1790919384.238410:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919384.238415:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238422:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aeed5414 already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919384.238424:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238432:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919384.238438:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919384.238443:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919384.238470:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238476:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919384.238493:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238499:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000aeed5414/0x951c50ad159132e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132e7 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238517:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919384.238519:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238524:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006223e2b already unused, calling callback (000000009d3db3fa) 10000000:00010000:0.0:1790919384.238526:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238540:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919384.238545:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919384.238549:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919384.238561:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238566:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919384.238577:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238582:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000006223e2b/0x951c50ad1591329a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159132a1 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238590:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919384.238592:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919384.238593:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919384.238609:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075a6f6e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978106880:0@lo:103: 00000100:00100000:0.0:1790919384.238640:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.238673:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a927a96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978107008:0@lo:103: 00000100:00100000:0.0:1790919384.238693:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.238723:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106880 00000100:00100000:0.0:1790919384.238727:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106880 00010000:00010000:0.0:1790919384.238742:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159132e0 expref: 17 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.238759:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107008 00000100:00100000:0.0:1790919384.238762:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107008 00010000:00010000:0.0:1790919384.238770:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591329a expref: 18 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.238788:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919384.238794:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f02ed7ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:3461:x1877914978106880:12345-0@lo:103: 00010000:00010000:0.0:1790919384.238803:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919384.238807:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159132e0 expref: 18 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238815:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159132e0 expref: 18 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238828:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919384.238856:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f02ed7ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:3461:x1877914978106880:12345-0@lo:103: Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.238863:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919384.238889:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919384.238895:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007c025ec3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3458:x1877914978107008:12345-0@lo:103: 00010000:00010000:0.0:1790919384.238901:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919384.238909:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591329a expref: 17 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238916:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591329a expref: 17 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.238925:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919384.238957:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007c025ec3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3458:x1877914978107008:12345-0@lo:103: Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.238963:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919384.238999:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a927a96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978107008:0@lo:103: 00000100:00100000:0.0:1790919384.239018:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075a6f6e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978106880:0@lo:103: 00010000:00010000:1.0:1790919384.239257:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919384.241613:0:6439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913269 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.241657:0:6439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913269 expref: 16 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.241671:0:6439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978107136:0@lo:104: 00000100:00100000:1.0:1790919384.241720:0:6439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919384.241750:0:6439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591322a expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.241759:0:6439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591322a expref: 16 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.241767:0:6439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004942f0be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978107264:0@lo:104: 00000100:00100000:1.0:1790919384.241788:0:6439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.241798:0:6439:0:(client.c:2716:ptlrpc_set_wait()) set 00000000414a0e40 going to sleep for 11 seconds 00010000:00010000:1.0:1790919384.241820:0:6439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f509f775/0x951c50ad159132e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159132e0 expref: 16 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.241833:0:6439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032457f71 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978106496:0@lo:104: 00010000:00010000:1.0:1790919384.241843:0:6439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b414bd3f/0x951c50ad159132a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591329a expref: 15 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.241852:0:6439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7de5357 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978106624:0@lo:104: 00000100:00100000:2.0:1790919384.242031:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978106752 00000100:00100000:2.0:1790919384.242040:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978106752 00000100:00100000:2.0:1790919384.242180:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107136 00000100:00100000:2.0:1790919384.242184:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107136 00000100:00100000:2.0:1790919384.242195:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107264 00000100:00100000:2.0:1790919384.242206:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107264 00000100:00100000:2.0:1790919384.242237:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919384.242244:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f22c705f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:6439:x1877914978106752:12345-0@lo:104: 00010000:00010000:2.0:1790919384.242257:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242315:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919384.242321:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f22c705f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:6439:x1877914978106752:12345-0@lo:104: Request processed in 77us (4285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.242327:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919384.242343:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919384.242348:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005b63da27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6439:x1877914978107136:12345-0@lo:104: 00010000:00010000:2.0:1790919384.242354:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242382:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790919384.242386:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005b63da27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6439:x1877914978107136:12345-0@lo:104: Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.242392:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919384.242402:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919384.242406:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007fced032 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6439:x1877914978107264:12345-0@lo:104: 00010000:00010000:2.0:1790919384.242412:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242442:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790919384.242447:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007fced032 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6439:x1877914978107264:12345-0@lo:104: Request processed in 41us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.242452:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790919384.242473:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790919384.242478:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242485:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063330b95 already unused, calling callback (000000009d3db3fa) 10000000:00010000:2.0:1790919384.242488:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242496:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919384.242502:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919384.242507:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919384.242546:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242552:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919384.242567:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242572:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000063330b95/0x951c50ad15913277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591327e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242583:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919384.242586:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242591:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020c9e874 already unused, calling callback (000000009d3db3fa) 10000000:00010000:2.0:1790919384.242593:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242604:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919384.242609:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919384.242613:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919384.242625:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242631:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919384.242642:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242648:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000020c9e874/0x951c50ad15913269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913270 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242658:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919384.242659:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242665:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004266e104 already unused, calling callback (000000009d3db3fa) 10000000:00010000:2.0:1790919384.242667:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242672:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919384.242677:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919384.242687:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919384.242701:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242707:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919384.242711:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242716:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000004266e104/0x951c50ad1591322a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913231 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.242731:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.242733:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.242734:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919384.242801:0:6439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f4a3b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978106752:0@lo:104: 00000100:00100000:1.0:1790919384.242810:0:6439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978107136:0@lo:104: 00000100:00100000:1.0:1790919384.242816:0:6439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004942f0be pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6439:1877914978107264:0@lo:104: 00010000:00010000:1.0:1790919384.242839:0:6439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.242892:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bfb561c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978107392:0@lo:103: 00000100:00100000:1.0:1790919384.242922:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.243177:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047d09f24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978107520:0@lo:103: 00000100:00100000:0.0:1790919384.243218:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edcb33a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978107648:0@lo:103: 00010000:00010000:0.0:1790919384.243262:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919384.243276:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919384.243489:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.243597:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919384.243879:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107392 00000100:00100000:3.0:1790919384.243886:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107392 00010000:00010000:3.0:1790919384.243914:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913277 expref: 15 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.243953:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107520 00000100:00100000:3.0:1790919384.243956:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107520 00010000:00010000:3.0:1790919384.243966:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913269 expref: 16 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.243977:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107648 00000100:00100000:3.0:1790919384.243979:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107648 00010000:00010000:3.0:1790919384.243986:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591322a expref: 17 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.244014:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919384.244021:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004942f0be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3459:x1877914978107392:12345-0@lo:103: 00010000:00010000:3.0:1790919384.244033:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919384.244038:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913277 expref: 17 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244049:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913277 expref: 17 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244191:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004eaa1f29/0x951c50ad1591327e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913277 expref: 17 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244204:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919384.244246:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004942f0be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3459:x1877914978107392:12345-0@lo:103: Request processed in 225us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.244253:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919384.244267:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919384.244272:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000075a6f6e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3460:x1877914978107520:12345-0@lo:103: 00010000:00010000:3.0:1790919384.244279:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919384.244282:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913269 expref: 15 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244289:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913269 expref: 15 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244297:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d8951bc/0x951c50ad15913270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913269 expref: 15 pid: 6439 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244315:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919384.244340:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000075a6f6e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:3460:x1877914978107520:12345-0@lo:103: Request processed in 68us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.244346:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919384.244359:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919384.244364:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d720b096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:3461:x1877914978107648:12345-0@lo:103: 00010000:00010000:3.0:1790919384.244371:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919384.244374:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591322a expref: 13 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244382:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591322a expref: 13 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244393:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd1723c9/0x951c50ad15913231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591322a expref: 13 pid: 6440 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244402:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244409:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244422:0:7709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244427:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244432:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244443:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244448:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ce842a82 already unused, calling callback (000000009f3081ad) 00010000:00010000:3.0:1790919384.244451:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244457:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244471:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.244487:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919384.244513:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d720b096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:3461:x1877914978107648:12345-0@lo:103: Request processed in 149us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.244519:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1790919384.244789:0:6439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.244797:0:6439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.244802:0:6439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce842a82/0x951c50ad15913349 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790919384.244816:0:6439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790919384.245157:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047d09f24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978107520:0@lo:103: 00000100:00100000:0.0:1790919384.245185:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edcb33a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978107648:0@lo:103: 00000100:00100000:0.0:1790919384.245207:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bfb561c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978107392:0@lo:103: 00000100:00100000:2.0:1790919384.300397:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002208b8f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:8080:x1877914978106368:12345-0@lo:253: Request processed in 75516us (75901us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.300413:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790919384.300521:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f94fd4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978106368:0@lo:253: 10000000:01000000:1.0:1790919384.300544:0:8080:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790919384.300548:0:8080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919384.300550:0:8080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919384.300551:0:8080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919384.300552:0:8080:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1790919384.300554:0:8080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919384.300555:0:8080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919384.300557:0:8080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919384.300559:0:8080:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790919384.300560:0:8080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919384.300561:0:8080:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790919384.300581:0:8080:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c229e8a1 from lustre-OST0000 10000000:01000000:1.0:1790919384.300603:0:8080:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790919384.300606:0:8080:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790919384.300614:0:8080:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f3908ab380 local copy 10000000:01000000:1.0:1790919384.300618:0:8080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790919384.300651:0:8080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.300677:0:8080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.300686:0:8080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.300702:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978107776:0@lo:101: 00000100:00100000:1.0:1790919384.300736:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.300774:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 0000000030c4a395 going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.301020:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107776 00000100:00100000:2.0:1790919384.301026:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107776 00000100:00100000:2.0:1790919384.301152:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919384.301161:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0416be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:8080:x1877914978107776:12345-0@lo:101: 00010000:00010000:2.0:1790919384.301174:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919384.301185:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6fcc30e/0x951c50ad15913357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913350 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.301206:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6fcc30e/0x951c50ad15913357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913350 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.301214:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6fcc30e/0x951c50ad15913357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913350 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.301229:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6fcc30e, rc 0) 00000100:00100000:2.0:1790919384.301258:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0416be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978107776:12345-0@lo:101: Request processed in 99us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.301264:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919384.301992:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007363d8de pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978107776:0@lo:101: 00010000:00010000:0.0:1790919384.302008:0:8080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.302016:0:8080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.302290:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a927a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978107904:0@lo:501: 00000100:00100000:0.0:1790919384.302330:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.302366:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1c7c019 going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.302467:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978107904 00000100:00100000:2.0:1790919384.302473:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978107904 00000100:00100000:2.0:1790919384.302513:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790919384.302520:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000012c86634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978107904:12345-0@lo:501: 00000100:00100000:2.0:1790919384.302999:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000012c86634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978107904:12345-0@lo:501: Request processed in 479us (667us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919384.303006:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790919384.307195:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a927a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978107904:0@lo:501: 10000000:01000000:1.0:1790919384.307228:0:8080:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790919384.307288:0:8080:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790919384.307296:0:8080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.307307:0:8080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.307314:0:8080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.307339:0:8080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790919384.307363:0:8080:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3be491000 10000000:01000000:1.0:1790919384.307368:0:8080:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790919384.307374:0:8080:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790919384.307377:0:8080:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919384.307381:0:8080:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790919384.307383:0:8080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919384.307442:0:8080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.307449:0:8080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.307460:0:8080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.307480:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108032:0@lo:101: 00000100:00100000:1.0:1790919384.307550:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.307652:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e998272 going to sleep for 11 seconds 00010000:00010000:2.0:1790919384.308245:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919384.308252:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.308261:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b414bd3f already unused, calling callback (000000009d3db3fa) 10000000:00010000:2.0:1790919384.308265:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.308271:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919384.308277:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919384.308282:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919384.308307:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.308325:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919384.308359:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.308365:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000b414bd3f/0x951c50ad15913350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913357 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.308380:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.308382:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.308383:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919384.308438:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030207f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978108160:0@lo:103: 00000100:00100000:0.0:1790919384.308476:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919384.308570:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108160 00000100:00100000:2.0:1790919384.308576:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108160 00000100:00100000:2.0:1790919384.308627:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919384.308634:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db76056c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:3458:x1877914978108160:12345-0@lo:103: 00010000:00010000:2.0:1790919384.308646:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919384.308659:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6fcc30e/0x951c50ad15913357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913350 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.308673:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919384.308709:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db76056c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:3458:x1877914978108160:12345-0@lo:103: Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.308716:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919384.308743:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030207f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978108160:0@lo:103: 00000100:00100000:3.0:1790919384.311520:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108032 00000100:00100000:3.0:1790919384.311543:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108032 00000100:00100000:3.0:1790919384.311710:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919384.311720:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001eaf8e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+11:8080:x1877914978108032:12345-0@lo:101: 00010000:00010000:3.0:1790919384.311739:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919384.311759:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059a5d1f8/0x951c50ad15913365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591335e expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.311785:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059a5d1f8/0x951c50ad15913365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591335e expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.311795:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059a5d1f8/0x951c50ad15913365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591335e expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.311817:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059a5d1f8, rc 0) 00000100:00100000:3.0:1790919384.312089:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001eaf8e3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108032:12345-0@lo:101: Request processed in 371us (4539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.312097:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790919384.312354:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108032:0@lo:101: 00010000:00010000:1.0:1790919384.312371:0:8080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.312381:0:8080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919384.312493:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108288:0@lo:501: 00000100:00100000:1.0:1790919384.312541:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.312609:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e998272 going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.312739:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108288 00000100:00100000:2.0:1790919384.312745:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108288 00000100:00100000:2.0:1790919384.312812:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790919384.312819:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005be0ff6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108288:12345-0@lo:501: 00000100:00100000:2.0:1790919384.313229:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005be0ff6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108288:12345-0@lo:501: Request processed in 410us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.313237:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790919384.313323:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108288:0@lo:501: 00000100:00100000:1.0:1790919384.313353:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108416:0@lo:503: 00000100:00100000:1.0:1790919384.313388:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.313551:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e998272 going to sleep for 11 seconds 00000100:00100000:0.0:1790919384.313621:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108416 00000100:00100000:0.0:1790919384.313627:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108416 00000100:00100000:0.0:1790919384.313648:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790919384.313653:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bea51c92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108416:12345-0@lo:503: 00000100:00100000:0.0:1790919384.313797:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bea51c92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108416:12345-0@lo:503: Request processed in 143us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.313804:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790919384.314035:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108416:0@lo:503: 00000040:00080000:1.0:1790919384.314345:0:8080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919384.314418:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108544:0@lo:502: 00000100:00100000:1.0:1790919384.314458:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.314480:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e998272 going to sleep for 11 seconds 00000100:00100000:0.0:1790919384.314618:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108544 00000100:00100000:0.0:1790919384.314624:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108544 00000100:00100000:0.0:1790919384.314643:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790919384.314648:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067ab4a34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108544:12345-0@lo:502: 00000100:00100000:0.0:1790919384.314795:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067ab4a34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108544:12345-0@lo:502: Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.314802:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790919384.314950:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108544:0@lo:502: 00000040:00080000:1.0:1790919384.315375:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790919384.315426:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790919384.315461:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790919384.315511:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790919384.315563:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790919384.315600:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790919384.315627:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108672:0@lo:502: 00000100:00100000:1.0:1790919384.315674:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.315701:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e998272 going to sleep for 11 seconds 00000100:00100000:0.0:1790919384.315767:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108672 00000100:00100000:0.0:1790919384.315772:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108672 00000100:00100000:0.0:1790919384.315798:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790919384.315804:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d98658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108672:12345-0@lo:502: 00000100:00100000:0.0:1790919384.316191:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d98658 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108672:12345-0@lo:502: Request processed in 387us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.316207:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790919384.316341:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa51bfad pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108672:0@lo:502: 00000040:00080000:1.0:1790919384.316421:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790919384.316430:0:8080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790919384.317652:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790919384.317661:0:8099:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790919384.317668:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919384.317670:0:8099:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790919384.317675:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919384.317689:0:8099:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000007cc81204) 00000020:00000080:1.0:1790919384.317711:0:8099:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790919384.317716:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790919384.319132:0:8099:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c229e8a1 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790919384.319147:0:8099:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790919384.319155:0:8099:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x951c50ad15913373 00010000:00010000:0.0:1790919384.323982:0:8099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1790919384.324386:0:8099:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1790919384.327894:0:8099:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790919384.328295:0:8099:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790919384.334361:0:8099:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790919384.334858:0:8099:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790919384.336683:0:8099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790919384.336694:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919384.336700:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919384.336702:0:8099:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790919384.336705:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919384.336709:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919384.336710:0:8099:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790919384.336713:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790919384.336715:0:8099:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790919384.336767:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919384.336771:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919384.336772:0:8099:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790919384.336775:0:8099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790919384.345035:0:8080:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790919384.345182:0:8080:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790919384.345200:0:8080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.345213:0:8080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000bee5aa2d/0x951c50ad1591335e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919384.345221:0:8080:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3be491000 from 1 10000000:01000000:3.0:1790919384.345224:0:8080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919384.345260:0:8080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000007b0b70a4/0x951c50ad1591337a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.345267:0:8080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000007b0b70a4/0x951c50ad1591337a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.345277:0:8080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000007b0b70a4/0x951c50ad1591337a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.345296:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d313bf61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108800:0@lo:101: 00000100:00100000:3.0:1790919384.345352:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919384.345396:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000007535cfd7 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.345458:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108800 00000100:00100000:1.0:1790919384.345465:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108800 00000100:00100000:1.0:1790919384.345508:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790919384.345527:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b0e5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978108800:12345-0@lo:101: 00010000:00010000:1.0:1790919384.345551:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919384.345563:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b53e7ab9/0x951c50ad15913381 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591337a expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.345593:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b53e7ab9/0x951c50ad15913381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591337a expref: 13 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.345604:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b53e7ab9/0x951c50ad15913381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591337a expref: 13 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.345610:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b53e7ab9, rc 0) 00000100:00100000:1.0:1790919384.345648:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b0e5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978108800:12345-0@lo:101: Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.345655:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919384.345730:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d313bf61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108800:0@lo:101: 00010000:00010000:3.0:1790919384.345743:0:8080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000007b0b70a4/0x951c50ad1591337a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.345757:0:8080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000007b0b70a4/0x951c50ad1591337a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.345841:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d313bf61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108928:0@lo:501: 00000100:00100000:3.0:1790919384.345866:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919384.345920:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 000000007535cfd7 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.348268:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978108928 00000100:00100000:1.0:1790919384.348281:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978108928 00000100:00100000:1.0:1790919384.348330:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790919384.348338:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003e1fcff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978108928:12345-0@lo:501: 00000100:00100000:1.0:1790919384.348624:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003e1fcff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978108928:12345-0@lo:501: Request processed in 287us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.348633:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919384.348898:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d313bf61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978108928:0@lo:501: 00000100:00100000:0.0:1790919384.348944:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050d4d119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109056:0@lo:503: 00000100:00100000:0.0:1790919384.348988:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.349083:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0e5abb6 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.349693:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109056 00000100:00100000:1.0:1790919384.349700:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109056 00000100:00100000:1.0:1790919384.349770:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790919384.349777:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4da68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109056:12345-0@lo:503: 00000100:00100000:1.0:1790919384.349993:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4da68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109056:12345-0@lo:503: Request processed in 218us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.350010:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919384.350150:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050d4d119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109056:0@lo:503: 00000040:00080000:0.0:1790919384.350407:0:8080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919384.350462:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050d4d119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109184:0@lo:502: 00000100:00100000:0.0:1790919384.350500:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.350710:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0e5abb6 going to sleep for 11 seconds 00000100:00100000:3.0:1790919384.350794:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109184 00000100:00100000:3.0:1790919384.350799:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109184 00000100:00100000:3.0:1790919384.350820:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919384.350825:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000014198d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109184:12345-0@lo:502: 00000100:00100000:3.0:1790919384.350974:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000014198d22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109184:12345-0@lo:502: Request processed in 148us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.350981:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790919384.351048:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050d4d119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109184:0@lo:502: 00000040:00080000:0.0:1790919384.351369:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790919384.351411:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790919384.351431:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050d4d119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109312:0@lo:502: 00000100:00100000:0.0:1790919384.351466:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.351524:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0e5abb6 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.351592:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109312 00000100:00100000:1.0:1790919384.351597:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109312 00000100:00100000:2.0:1790919384.351645:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919384.351653:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008f1a48c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109312:12345-0@lo:502: 00000100:00100000:2.0:1790919384.351773:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008f1a48c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109312:12345-0@lo:502: Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.351780:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790919384.351832:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050d4d119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109312:0@lo:502: 00000040:00080000:0.0:1790919384.351898:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790919384.351907:0:8080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790919384.352490:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919384.352498:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919384.352501:0:8103:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790919384.352507:0:8103:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3be491000 00000020:00000080:1.0:1790919384.352509:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919384.352661:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919384.352666:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919384.352668:0:8103:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790919384.352671:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790919384.352797:0:8080:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790919384.352828:0:8080:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919384.352847:0:8080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.352859:0:8080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919384.352894:0:8080:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790919384.352897:0:8080:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3be491000 10000000:01000000:0.0:1790919384.352899:0:8080:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3be491000 10000000:01000000:0.0:1790919384.352903:0:8080:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919384.352908:0:8080:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3be491000 from 1 10000000:01000000:0.0:1790919384.352911:0:8080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919384.352938:0:8080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.352946:0:8080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.352968:0:8080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.352985:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109440:0@lo:101: 00000100:00100000:0.0:1790919384.353031:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.353149:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.353374:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109440 00000100:00100000:1.0:1790919384.353381:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109440 00000100:00100000:1.0:1790919384.353409:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790919384.353417:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8080:x1877914978109440:12345-0@lo:101: 00010000:00010000:1.0:1790919384.353429:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919384.353441:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913388 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.353463:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913388 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.353473:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913388 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.353480:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:1.0:1790919384.353527:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109440:12345-0@lo:101: Request processed in 110us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.353544:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790919384.353664:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109440:0@lo:101: 00010000:00010000:0.0:1790919384.353677:0:8080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.353685:0:8080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.353769:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109568:0@lo:501: 00000100:00100000:0.0:1790919384.353797:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.353823:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.353866:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109568 00000100:00100000:1.0:1790919384.353871:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109568 00000100:00100000:1.0:1790919384.353889:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790919384.353895:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109568:12345-0@lo:501: 00000100:00100000:1.0:1790919384.354238:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109568:12345-0@lo:501: Request processed in 341us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.354245:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790919384.354326:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109568:0@lo:501: 00000100:00100000:0.0:1790919384.354355:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109696:0@lo:503: 00000100:00100000:0.0:1790919384.354395:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.354425:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.354467:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109696 00000100:00100000:1.0:1790919384.354472:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109696 00000100:00100000:1.0:1790919384.354492:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790919384.354498:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109696:12345-0@lo:503: 00000100:00100000:1.0:1790919384.354741:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109696:12345-0@lo:503: Request processed in 242us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.354748:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790919384.354932:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109696:0@lo:503: 00000040:00080000:0.0:1790919384.355716:0:8080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919384.355777:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109824:0@lo:502: 00000100:00100000:0.0:1790919384.355825:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.355895:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919384.355940:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109824 00000100:00100000:1.0:1790919384.355945:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109824 00000100:00100000:1.0:1790919384.356020:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790919384.356029:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109824:12345-0@lo:502: 00000100:00100000:1.0:1790919384.356430:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109824:12345-0@lo:502: Request processed in 401us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.356437:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790919384.356795:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109824:0@lo:502: 00000040:00080000:0.0:1790919384.357049:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790919384.357303:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790919384.357335:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790919384.357376:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790919384.357405:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790919384.357446:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790919384.357480:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790919384.357519:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790919384.357576:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790919384.357661:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790919384.357689:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790919384.357728:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790919384.357755:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790919384.357781:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790919384.357816:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790919384.357843:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790919384.357869:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790919384.357905:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790919384.357932:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790919384.357960:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790919384.358013:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790919384.358043:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790919384.358415:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790919384.358480:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790919384.358511:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790919384.358553:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790919384.358653:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790919384.358686:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1790919384.358714:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790919384.358769:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1790919384.358801:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1790919384.358835:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1790919384.358862:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1790919384.358899:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1790919384.358926:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1790919384.358973:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1790919384.359003:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1790919384.359043:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109952:0@lo:502: 00000100:00100000:0.0:1790919384.359246:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.359325:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.359427:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978109952 00000100:00100000:2.0:1790919384.359434:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978109952 00000100:00100000:2.0:1790919384.359537:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790919384.359547:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109952:12345-0@lo:502: 00000100:00100000:2.0:1790919384.359828:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978109952:12345-0@lo:502: Request processed in 282us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.359835:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790919384.359910:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978109952:0@lo:502: 00000040:00080000:0.0:1790919384.359983:0:8080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1790919384.359995:0:8080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790919384.360652:0:8104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790919384.360668:0:8104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95f3b42b3380) 00000020:00000080:0.0:1790919384.360689:0:8104:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1790919384.360773:0:8104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3be491000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790919384.360776:0:8104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3be491000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790919384.360779:0:8104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3be491000 3 00010000:00080000:0.0:1790919384.360813:0:8104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3b4715800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919384.363335:0:8104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1790919384.363549:0:8104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790919384.364271:0:8104:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790919384.364283:0:8104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x951c50ad1591339d 00000100:00080000:0.0:1790919384.364293:0:8104:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919384.364304:0:8104:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f3b4715800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919384.364336:0:8104:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f391514a80 x1877914978110080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919384.364397:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978110080:0@lo:38: 00000100:00100000:3.0:1790919384.364463:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790919384.364638:0:8104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790919384.367428:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978110592:0@lo:400: 00000100:00100000:2.0:1790919384.367498:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.368854:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978110336:0@lo:400: 00000100:00100000:0.0:1790919384.369360:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919384.369409:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919384.369416:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978110464:0@lo:400: 00000100:00100000:0.0:1790919384.369444:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919384.370144:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110336 00000100:00100000:3.0:1790919384.370154:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110336 00000100:00100000:3.0:1790919384.370195:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110464 00000100:00100000:3.0:1790919384.370199:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110464 00000100:00100000:3.0:1790919384.370219:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919384.370228:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978110336:12345-0@lo:400: 00000100:00100000:2.0:1790919384.370271:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919384.370283:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978110208:0@lo:400: 00000100:00100000:3.0:1790919384.370299:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978110336:12345-0@lo:400: Request processed in 70us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.370307:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919384.370319:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919384.370327:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790919384.370336:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978110464:12345-0@lo:400: 00000100:00100000:3.0:1790919384.370378:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978110464:12345-0@lo:400: Request processed in 43us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919384.370384:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919384.370440:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110080 00000100:00100000:2.0:1790919384.370445:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110080 00000100:00100000:1.0:1790919384.370449:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110592 00000100:00100000:1.0:1790919384.370455:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110592 00000100:00100000:2.0:1790919384.370471:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110208 00000100:00100000:2.0:1790919384.370476:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110208 00000100:00100000:1.0:1790919384.370490:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919384.370499:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978110592:12345-0@lo:400: 00000100:00100000:2.0:1790919384.370511:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919384.370520:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978110208:12345-0@lo:400: 00000100:00100000:1.0:1790919384.370559:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978110592:12345-0@lo:400: Request processed in 62us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919384.370566:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919384.370599:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978110208:12345-0@lo:400: Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.370607:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919384.370622:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919384.370626:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978110080:12345-0@lo:38: 00010000:00080000:2.0:1790919384.370646:0:6445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00010000:00080000:1.0:1790919384.370837:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f38d54bb80 x1877914978110208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919384.370849:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978110208:0@lo:400: 00010000:00080000:1.0:1790919384.370860:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f38d548a80 x1877914978110592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919384.370867:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978110592:0@lo:400: 00000020:00000080:2.0:1790919384.371157:0:6445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x951c50ad159133a4 00000004:00100000:2.0:1790919384.371177:0:6445:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790919384.371223:0:6445:0:(import.c:65:import_set_state_nolock()) ffff95f2843f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919384.371276:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1877914978110080:12345-0@lo:38: Request processed in 647us (6811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.371285:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790919384.371320:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f391514a80 x1877914978110080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919384.371330:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919384.371337:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790919384.371344:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790919384.371349:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790919384.371352:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790919384.371357:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978110080:0@lo:38: 00000020:01000004:1.0:1790919384.371496:0:8104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790919384.371511:0:8104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff95f3bdfe3380) 00000020:00000080:1.0:1790919384.371540:0:8104:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1790919384.372023:0:8104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3be491000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790919384.372028:0:8104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3be491000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790919384.372031:0:8104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3be491000 3 00010000:00080000:1.0:1790919384.372089:0:8104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f284001000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00000100:00100000:0.0:1790919384.373248:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978110464:0@lo:400: 00000100:00100000:0.0:1790919384.373264:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978110336:0@lo:400: 00010000:00010000:1.0:1790919384.377083:0:8104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1790919384.377254:0:8104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1790919384.377297:0:8104:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919384.377312:0:8104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x951c50ad159133b2 00000100:00080000:1.0:1790919384.377323:0:8104:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919384.377336:0:8104:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff95f284001000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919384.377376:0:8104:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e25c00 x1877914978110720/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919384.377464:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978110720:0@lo:38: 00000100:00100000:3.0:1790919384.377546:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919384.377667:0:8104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790919384.380823:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110720 00000100:00100000:0.0:1790919384.380837:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110720 00000100:00100000:0.0:1790919384.380888:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919384.380896:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978110720:12345-0@lo:38: 00010000:00080000:0.0:1790919384.380926:0:6446:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1790919384.380965:0:6446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x951c50ad159133b9 00000004:00100000:0.0:1790919384.380980:0:6446:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919384.381012:0:6446:0:(import.c:65:import_set_state_nolock()) ffff95f3b6256800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919384.381119:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1877914978110720:12345-0@lo:38: Request processed in 222us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.381126:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790919384.381248:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f382e25c00 x1877914978110720/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919384.381260:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919384.381267:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790919384.381273:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790919384.381276:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790919384.381278:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284001000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790919384.381284:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978110720:0@lo:38: 00000040:00080000:2.0:1790919384.381853:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1790919384.382807:0:8080:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790919384.382837:0:8080:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919384.382862:0:8080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919384.382891:0:8080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919384.382936:0:8080:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919384.382938:0:8080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919384.382939:0:8080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919384.382941:0:8080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919384.382942:0:8080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919384.382943:0:8080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919384.382945:0:8080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919384.382946:0:8080:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790919384.382948:0:8080:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790919384.382949:0:8080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919384.382951:0:8080:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919384.382954:0:8080:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790919384.382957:0:8080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919384.382959:0:8080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919384.382960:0:8080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919384.382961:0:8080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919384.382962:0:8080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919384.382963:0:8080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919384.382964:0:8080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919384.382965:0:8080:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790919384.382966:0:8080:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790919384.382967:0:8080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919384.382968:0:8080:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919384.382992:0:8080:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790919384.383008:0:8080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978110848:0@lo:253: 00000100:00100000:1.0:1790919384.383087:0:8080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919384.383127:0:8080:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.384760:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110848 00000100:00100000:2.0:1790919384.384772:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110848 00000100:00100000:2.0:1790919384.384834:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790919384.384843:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:8080:x1877914978110848:12345-0@lo:253: 20000000:01000000:2.0:1790919384.384874:0:6438:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790919384.384888:0:6438:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790919384.429392:0:6438:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790919384.429410:0:6438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790919384.429796:0:6461:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790919384.429801:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790919384.429822:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.429856:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.429864:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591331f expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.429872:0:6461:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.429907:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591331f expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.429919:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591331f expref: 14 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.429942:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978110976:0@lo:104: 00000100:00100000:3.0:1790919384.430000:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919384.430038:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919384.430046:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919384.430085:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978111104:0@lo:104: 00000100:00100000:3.0:1790919384.430107:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57840 going to sleep for 11 seconds 00000100:00100000:2.0:1790919384.430241:0:6428:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790919384.430258:0:6428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919384.430282:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978110976 00000100:00100000:2.0:1790919384.430289:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978110976 00000100:00100000:2.0:1790919384.430318:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111104 00000100:00100000:2.0:1790919384.430320:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111104 00000100:00100000:2.0:1790919384.430331:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919384.430343:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdffec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6461:x1877914978110976:12345-0@lo:104: 00010000:00010000:2.0:1790919384.430355:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430399:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919384.430404:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdffec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6461:x1877914978110976:12345-0@lo:104: Request processed in 63us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.430411:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919384.430457:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919384.430463:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978111104:12345-0@lo:104: 00010000:00010000:2.0:1790919384.430470:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430497:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790919384.430501:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978111104:12345-0@lo:104: Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.430507:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1790919384.430520:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919384.430525:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430542:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919384.430546:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430555:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919384.430562:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919384.430573:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1790919384.430591:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978110976:0@lo:104: 00010000:00010000:2.0:1790919384.430600:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.430600:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978111104:0@lo:104: 00010000:00010000:2.0:1790919384.430606:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919384.430617:0:6461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430622:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430628:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad1591331f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913326 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430728:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919384.430733:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430740:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919384.430743:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430750:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919384.430756:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919384.430761:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919384.430773:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430778:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919384.430799:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430806:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad15913311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913318 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.430819:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.430820:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.430822:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919384.430828:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919384.430845:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978111232:0@lo:103: 00000100:00100000:2.0:1790919384.430873:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919384.430921:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978111360:0@lo:103: 00000100:00100000:0.0:1790919384.431024:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111232 00000100:00100000:0.0:1790919384.431030:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111232 00010000:00010000:0.0:1790919384.431048:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591331f expref: 15 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.431118:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919384.431125:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3459:x1877914978111232:12345-0@lo:103: 00010000:00010000:0.0:1790919384.431136:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919384.431141:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591331f expref: 15 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.431149:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591331f expref: 15 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.431162:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166da00/0x951c50ad15913326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591331f expref: 15 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919384.431173:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919384.431206:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:3459:x1877914978111232:12345-0@lo:103: Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919384.431212:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919384.431398:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919384.431436:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111360 00000100:00100000:2.0:1790919384.431441:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111360 00010000:00010000:2.0:1790919384.431455:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919384.431776:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919384.431784:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:3460:x1877914978111360:12345-0@lo:103: 00010000:00010000:2.0:1790919384.431793:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919384.431797:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431807:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431816:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166ce00/0x951c50ad15913318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913311 expref: 14 pid: 6438 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431839:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431846:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790919384.431859:0:7709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002058499s 00010000:00010000:2.0:1790919384.431863:0:7709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431869:0:7709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431876:0:7709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431883:0:7709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431888:0:7709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919384.431892:0:7709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431899:0:7709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.431913:0:7709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.432536:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919384.432601:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:3460:x1877914978111360:12345-0@lo:103: Request processed in 817us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.432609:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919384.432673:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978111232:0@lo:103: 00010000:00010000:2.0:1790919384.432693:0:6461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.432702:0:6461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919384.432709:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381696200/0x951c50ad159133c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919384.433127:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978111360:0@lo:103: 00000100:00100000:2.0:1790919384.439828:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:8080:x1877914978110848:12345-0@lo:253: Request processed in 54977us (56731us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919384.439843:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790919384.440125:0:8080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8080:1877914978110848:0@lo:253: 10000000:01000000:1.0:1790919384.440140:0:8080:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790919384.440144:0:8080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919384.440145:0:8080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919384.440160:0:8080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919384.440161:0:8080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919384.440162:0:8080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919384.440164:0:8080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919384.440165:0:8080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919384.440167:0:8080:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790919384.440168:0:8080:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790919384.440170:0:8080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919384.440171:0:8080:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790919384.440192:0:8080:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919384.446780:0:8080:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919384.447023:0:8080:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919384.447225:0:8080:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919384.447371:0:8080:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919384.447559:0:8080:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919384.447765:0:8080:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790919384.450766:0:8080:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1790919384.476826:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1790919384.656697:0:8080:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790919384.656706:0:8080:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790919384.656737:0:8080:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790919384.656787:0:8080:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790919384.656802:0:8080:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790919384.656827:0:8080:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1790919385.501169:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919386.021910:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978111488:0@lo:41: 00000100:00100000:0.0:1790919386.021998:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.022212:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919386.022222:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978111616:0@lo:41: 00000100:00100000:0.0:1790919386.022248:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.022283:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111488 00000100:00100000:0.0:1790919386.022291:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111488 00000100:00100000:0.0:1790919386.022329:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111616 00000100:00100000:0.0:1790919386.022332:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111616 00000100:00100000:0.0:1790919386.022348:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919386.022366:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978111488:12345-0@lo:41: 00000004:00000024:0.0:1790919386.022408:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919386.022454:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978111488:12345-0@lo:41: Request processed in 89us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.022461:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919386.022479:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919386.022485:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978111616:12345-0@lo:41: 00000004:00000024:0.0:1790919386.022504:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919386.022549:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978111616:12345-0@lo:41: Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.022555:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919386.022595:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978111616:0@lo:41: 00000100:00100000:0.0:1790919386.022629:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978111488:0@lo:41: 10000000:01000000:2.0:1790919386.332155:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790919386.332164:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3b4712800 from 30 10000000:01000000:2.0:1790919386.332170:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790919386.332222:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.332234:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.332261:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.332285:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978111744:0@lo:101: 00000100:00100000:2.0:1790919386.332359:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.332410:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.332551:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111744 00000100:00100000:1.0:1790919386.332559:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111744 00000100:00100000:1.0:1790919386.332653:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790919386.332667:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+12:6443:x1877914978111744:12345-0@lo:101: 00010000:00010000:1.0:1790919386.332685:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919386.332698:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159133c7 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.332723:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159133c7 expref: 13 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.332734:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159133c7 expref: 13 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.332743:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166de00, rc 0) 00000100:00100000:1.0:1790919386.332798:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978111744:12345-0@lo:101: Request processed in 134us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.332814:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790919386.332892:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978111744:0@lo:101: 00010000:00010000:2.0:1790919386.332907:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.332916:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.332970:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978111872:0@lo:501: 00000100:00100000:2.0:1790919386.332995:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.333206:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.333266:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978111872 00000100:00100000:3.0:1790919386.333272:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978111872 00000100:00100000:3.0:1790919386.333292:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919386.333304:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978111872:12345-0@lo:501: 00000100:00100000:3.0:1790919386.333974:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978111872:12345-0@lo:501: Request processed in 667us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.333985:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919386.334261:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978111872:0@lo:501: 00000100:00100000:2.0:1790919386.334297:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112000:0@lo:503: 00000100:00100000:2.0:1790919386.334336:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.334401:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.334436:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112000 00000100:00100000:3.0:1790919386.334441:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112000 00000100:00100000:3.0:1790919386.334501:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790919386.334509:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978112000:12345-0@lo:503: 00000100:00100000:3.0:1790919386.334837:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978112000:12345-0@lo:503: Request processed in 328us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.334844:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919386.334917:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112000:0@lo:503: 00000100:00100000:0.0:1790919386.335314:0:8226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8226:1877914978112128:0@lo:502: 00000100:00100000:0.0:1790919386.335355:0:8226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.335387:0:8226:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.335443:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112128 00000100:00100000:2.0:1790919386.335448:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112128 00000100:00100000:2.0:1790919386.335481:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919386.335489:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8226:x1877914978112128:12345-0@lo:502: 00000100:00100000:2.0:1790919386.335719:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8226:x1877914978112128:12345-0@lo:502: Request processed in 229us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.335726:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790919386.335807:0:8226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8226:1877914978112128:0@lo:502: 00000100:00100000:0.0:1790919386.335844:0:8226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8226:1877914978112256:0@lo:502: 00000100:00100000:0.0:1790919386.335874:0:8226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.335894:0:8226:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.335944:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112256 00000100:00100000:2.0:1790919386.335948:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112256 00000100:00100000:2.0:1790919386.336003:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919386.336009:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8226:x1877914978112256:12345-0@lo:502: 00000100:00100000:2.0:1790919386.336147:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:8226:x1877914978112256:12345-0@lo:502: Request processed in 138us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.336154:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790919386.336302:0:8226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8226:1877914978112256:0@lo:502: 00000040:00080000:1.0:1790919386.336320:0:8226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790919386.336462:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790919386.336481:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790919386.336490:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.336502:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919386.336511:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919386.336524:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4712800 from 5 10000000:01000000:2.0:1790919386.336528:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919386.336554:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.336562:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.336571:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.336594:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112384:0@lo:101: 00000100:00100000:2.0:1790919386.336623:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.336652:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.336696:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112384 00000100:00100000:1.0:1790919386.336701:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112384 00000100:00100000:1.0:1790919386.336731:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790919386.336737:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+13:6443:x1877914978112384:12345-0@lo:101: 00010000:00010000:1.0:1790919386.336746:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919386.336759:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159133d5 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.336777:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159133d5 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.336786:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159133d5 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.336793:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166cc00, rc 0) 00000100:00100000:1.0:1790919386.336833:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978112384:12345-0@lo:101: Request processed in 95us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.336839:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919386.336949:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112384:0@lo:101: 00010000:00010000:2.0:1790919386.336961:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.336969:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.337008:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112512:0@lo:256: 00000100:00100000:2.0:1790919386.337041:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.337087:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.337205:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112512 00000100:00100000:1.0:1790919386.337210:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112512 00000100:00100000:1.0:1790919386.337232:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790919386.337238:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978112512:12345-0@lo:256: 20000000:01000000:1.0:1790919386.337251:0:6438:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919386.337267:0:6438:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919386.337274:0:6438:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790919386.337344:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978112512:12345-0@lo:256: Request processed in 106us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.337351:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790919386.337421:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112512:0@lo:256: 10000000:01000000:2.0:1790919386.337461:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919386.337472:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.337481:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919386.337489:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790919386.337492:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1790919386.337494:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790919386.337509:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.337538:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.337547:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.337559:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112640:0@lo:101: 00000100:00100000:2.0:1790919386.337584:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.337611:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.337654:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112640 00000100:00100000:1.0:1790919386.337658:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112640 00000100:00100000:1.0:1790919386.337685:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790919386.337691:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:6443:x1877914978112640:12345-0@lo:101: 00010000:00010000:1.0:1790919386.337697:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919386.337705:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159133e3 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.337718:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159133e3 expref: 15 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.337726:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159133e3 expref: 15 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.337733:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d800, rc 0) 00000100:00100000:1.0:1790919386.337771:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978112640:12345-0@lo:101: Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.337778:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790919386.337893:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112640:0@lo:101: 00010000:00010000:0.0:1790919386.337904:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919386.337913:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919386.337962:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112768:0@lo:501: 00000100:00100000:0.0:1790919386.337988:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.338011:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325d480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.338079:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112768 00000100:00100000:1.0:1790919386.338084:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112768 00000100:00100000:1.0:1790919386.338176:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790919386.338184:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978112768:12345-0@lo:501: 00000100:00100000:1.0:1790919386.338415:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978112768:12345-0@lo:501: Request processed in 232us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.338422:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790919386.338482:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112768:0@lo:501: 00000100:00100000:0.0:1790919386.338508:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112896:0@lo:503: 00000100:00100000:0.0:1790919386.338555:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.338619:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.338654:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978112896 00000100:00100000:2.0:1790919386.338658:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978112896 00000100:00100000:2.0:1790919386.338679:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919386.338684:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978112896:12345-0@lo:503: 00000100:00100000:2.0:1790919386.338986:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978112896:12345-0@lo:503: Request processed in 301us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.338995:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919386.339039:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978112896:0@lo:503: 00000100:00100000:0.0:1790919386.344739:0:8227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8227:1877914978113024:0@lo:502: 00000100:00100000:0.0:1790919386.344827:0:8227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.344902:0:8227:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325df00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.347169:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113024 00000100:00100000:2.0:1790919386.347183:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113024 00000100:00100000:2.0:1790919386.347232:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790919386.347241:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:8227:x1877914978113024:12345-0@lo:502: 00000100:00100000:2.0:1790919386.347581:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:8227:x1877914978113024:12345-0@lo:502: Request processed in 340us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.347589:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790919386.347715:0:8227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8227:1877914978113024:0@lo:502: 00000020:01000000:0.0:1790919386.347749:0:8227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790919386.347756:0:8227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:0.0:1790919386.347764:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919386.347766:0:8227:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790919386.347771:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790919386.347776:0:8227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1790919386.347796:0:8227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790919386.347799:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919386.347814:0:8227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff95f3b42b4d40) 00000020:00000080:0.0:1790919386.347835:0:8227:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1790919386.347842:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790919386.347927:0:8227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790919386.347933:0:8227:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790919386.347939:0:8227:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159133f8 00010000:00080000:0.0:1790919386.347967:0:8227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f385587000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919386.348259:0:8227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790919386.417757:0:8227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790919386.417778:0:8227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1790919386.418323:0:8227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919386.418485:0:8227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919386.418541:0:8227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790919386.418607:0:8227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790919386.420145:0:8234:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919386.420152:0:8234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790919386.424301:0:8227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790919386.424317:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790919386.424352:0:8227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790919386.424375:0:8227:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159133ff 00000100:00080000:1.0:1790919386.424385:0:8227:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919386.424396:0:8227:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f385587000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919386.424430:0:8227:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e27480 x1877914978113152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919386.424482:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978113152:0@lo:8: 00000100:00100000:2.0:1790919386.424564:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919386.424757:0:8227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790919386.424819:0:8227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919386.424823:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919386.424825:0:8227:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790919386.424828:0:8227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919386.424831:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919386.424832:0:8227:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790919386.424835:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790919386.424837:0:8227:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790919386.424860:0:8227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8227:1877914978113280:0@lo:502: 00000100:00100000:1.0:1790919386.424906:0:8227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.424951:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113280 00000100:00100000:1.0:1790919386.424958:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113280 00000100:00100000:1.0:1790919386.424993:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919386.425002:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:8227:x1877914978113280:12345-0@lo:502: 00000100:00100000:1.0:1790919386.425260:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:8227:x1877914978113280:12345-0@lo:502: Request processed in 258us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.425275:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919386.425312:0:8227:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.425332:0:8227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8227:1877914978113280:0@lo:502: 00000020:01000000:1.0:1790919386.425357:0:8227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919386.425361:0:8227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919386.425363:0:8227:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790919386.425367:0:8227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:0.0:1790919386.426012:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978113536:0@lo:400: 00000100:00100000:0.0:1790919386.426073:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.426104:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919386.426110:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978113664:0@lo:400: 00000100:00100000:0.0:1790919386.426136:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.426467:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113536 00000100:00100000:3.0:1790919386.426473:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113536 00000100:00100000:1.0:1790919386.426697:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978113408:0@lo:400: 00000100:00100000:1.0:1790919386.426727:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.426747:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919386.426753:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978113792:0@lo:400: 00000100:00100000:1.0:1790919386.426774:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.426825:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113664 00000100:00100000:3.0:1790919386.426829:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113664 00000100:00100000:3.0:1790919386.426862:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113408 00000100:00100000:3.0:1790919386.426865:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113408 00000100:00100000:3.0:1790919386.426873:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113792 00000100:00100000:3.0:1790919386.426875:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113792 00000100:00100000:3.0:1790919386.426889:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919386.426896:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978113536:12345-0@lo:400: 00000100:00100000:3.0:1790919386.426957:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978113536:12345-0@lo:400: Request processed in 60us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.426964:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919386.426980:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919386.426987:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978113664:12345-0@lo:400: 00000100:00100000:3.0:1790919386.427015:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978113664:12345-0@lo:400: Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.427032:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919386.427045:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919386.427073:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978113408:12345-0@lo:400: 00000100:00100000:3.0:1790919386.427109:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978113408:12345-0@lo:400: Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.427114:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919386.427127:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919386.427133:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978113792:12345-0@lo:400: 00000100:00100000:3.0:1790919386.427159:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978113792:12345-0@lo:400: Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.427164:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1790919386.427237:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919386.427241:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919386.427436:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113152 00000100:00100000:2.0:1790919386.427442:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113152 00000100:00100000:2.0:1790919386.427469:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919386.427475:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978113152:12345-0@lo:8: 00010000:00080000:2.0:1790919386.427500:0:8082:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1790919386.427546:0:8082:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15913406 00002000:00100000:2.0:1790919386.427590:0:8082:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff95f2843f7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790919386.427596:0:8082:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1790919386.427599:0:8082:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790919386.427723:0:8082:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790919386.427860:0:8082:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790919386.427882:0:8082:0:(import.c:65:import_set_state_nolock()) ffff95f2843f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919386.428167:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978113152:12345-0@lo:8: Request processed in 691us (3610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.428175:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1790919386.428201:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1790919386.428224:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790919386.428233:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.428244:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919386.428253:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919386.428255:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4712800 from 1 10000000:01000000:2.0:1790919386.428258:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919386.428305:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.428315:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.428323:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.428338:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978113920:0@lo:101: 00000100:00100000:2.0:1790919386.428376:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.428404:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2842599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.428427:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978113920 00000100:00100000:2.0:1790919386.428431:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978113920 00000100:00100000:2.0:1790919386.428459:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790919386.428465:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978113920:12345-0@lo:101: 00010000:00010000:2.0:1790919386.428475:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919386.428486:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591340d expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.428506:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591340d expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.428526:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591340d expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.428536:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204a000, rc 0) 00000100:00100000:2.0:1790919386.428887:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978113920:12345-0@lo:101: Request processed in 420us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.428893:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790919386.429097:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978113920:0@lo:101: 00010000:00010000:2.0:1790919386.429113:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.429122:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.429173:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114048:0@lo:501: 00000100:00100000:2.0:1790919386.429202:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.429216:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2842599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.429230:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114048 00000100:00100000:2.0:1790919386.429233:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114048 00000100:00100000:2.0:1790919386.429257:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790919386.429264:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978114048:12345-0@lo:501: 00000100:00100000:2.0:1790919386.429489:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978114048:12345-0@lo:501: Request processed in 224us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.429496:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790919386.429540:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114048:0@lo:501: 00010000:00080000:0.0:1790919386.430161:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514a80 x1877914978113792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919386.430173:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978113792:0@lo:400: 00010000:00080000:0.0:1790919386.430186:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514000 x1877914978113408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919386.430194:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978113408:0@lo:400: 00010000:00080000:0.0:1790919386.430232:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391516680 x1877914978113664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919386.430241:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978113664:0@lo:400: 00010000:00080000:0.0:1790919386.430253:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514380 x1877914978113536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919386.430261:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978113536:0@lo:400: 00000100:00100000:2.0:1790919386.430336:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114176:0@lo:503: 00000100:00100000:2.0:1790919386.430384:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.430419:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211e40 going to sleep for 11 seconds 00010000:00080000:2.0:1790919386.430445:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e27480 x1877914978113152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919386.430453:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919386.430460:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790919386.430467:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790919386.430472:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790919386.430481:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f385587000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790919386.430536:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790919386.430543:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978113152:0@lo:8: 00000004:00080000:2.0:1790919386.430589:0:8234:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790919386.430781:0:8234:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 195458727299ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790919386.431728:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114176 00000100:00100000:1.0:1790919386.431736:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114176 00000100:00100000:1.0:1790919386.431774:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790919386.431782:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978114176:12345-0@lo:503: 00000100:00100000:1.0:1790919386.432131:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978114176:12345-0@lo:503: Request processed in 349us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.432139:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790919386.432420:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114176:0@lo:503: 00000100:00100000:0.0:1790919386.433882:0:8235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978114304:0@lo:700: 00000100:00100000:0.0:1790919386.434134:0:8235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.434165:0:8235:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.439144:0:8236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8236:1877914978114432:0@lo:502: 00000100:00100000:0.0:1790919386.439224:0:8236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.439271:0:8236:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.440120:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114432 00000100:00100000:0.0:1790919386.440130:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114432 00000100:00100000:0.0:1790919386.440177:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790919386.440185:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:8236:x1877914978114432:12345-0@lo:502: 00000100:00100000:0.0:1790919386.440434:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:8236:x1877914978114432:12345-0@lo:502: Request processed in 248us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.440441:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790919386.440928:0:8236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8236:1877914978114432:0@lo:502: 00000020:01000000:0.0:1790919386.441750:0:8236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919386.441761:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919386.441763:0:8236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790919386.441771:0:8236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3b4712800 00000020:00000080:0.0:1790919386.441773:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790919386.441811:0:8236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8236:1877914978114560:0@lo:502: 00000100:00100000:0.0:1790919386.441872:0:8236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.441899:0:8236:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.442045:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114560 00000100:00100000:1.0:1790919386.442072:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114560 00000100:00100000:1.0:1790919386.442114:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790919386.442123:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:8236:x1877914978114560:12345-0@lo:502: 00000100:00100000:1.0:1790919386.442298:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:8236:x1877914978114560:12345-0@lo:502: Request processed in 175us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.442314:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790919386.442734:0:8236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8236:1877914978114560:0@lo:502: 00000020:01000000:0.0:1790919386.442758:0:8236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919386.442763:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919386.442765:0:8236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790919386.442769:0:8236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1790919386.443297:0:8091:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114304 00000100:00100000:3.0:1790919386.443304:0:8091:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114304 00000100:00100000:3.0:1790919386.443355:0:8091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919386.443364:0:8091:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8235:x1877914978114304:12345-0@lo:700: 00000100:00100000:3.0:1790919386.443405:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8091:1877914978114688:0@lo:700: 00000100:00100000:3.0:1790919386.443446:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.443471:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.443487:0:6452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114688 00000100:00100000:3.0:1790919386.443491:0:6452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114688 00000100:00080000:1.0:1790919386.444013:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919386.444048:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919386.444094:0:6452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8091:x1877914978114688:12345-0@lo:700: 00000020:01000000:2.0:1790919386.446169:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790919386.446203:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919386.446215:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.446227:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919386.446237:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790919386.446239:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f385571800 from 30 10000000:01000000:2.0:1790919386.446242:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790919386.446276:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.446285:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.446295:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.446316:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114816:0@lo:101: 00000100:00100000:2.0:1790919386.446381:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.446416:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.452833:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114816 00000100:00100000:2.0:1790919386.452847:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114816 00000100:00100000:2.0:1790919386.452898:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919386.452907:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978114816:12345-0@lo:101: 00010000:00010000:2.0:1790919386.452922:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919386.454824:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591341b expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.455449:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591341b expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.455462:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591341b expref: 17 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.455470:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204b600, rc 0) 00000100:00100000:2.0:1790919386.455560:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978114816:12345-0@lo:101: Request processed in 2648us (9173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.455568:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790919386.457527:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114816:0@lo:101: 00010000:00010000:0.0:1790919386.457551:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919386.457572:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919386.458021:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114944:0@lo:501: 00000100:00100000:0.0:1790919386.458093:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.458122:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.459346:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978114944 00000100:00100000:2.0:1790919386.459357:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978114944 00000100:00100000:2.0:1790919386.459399:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790919386.459408:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978114944:12345-0@lo:501: 00000100:00100000:2.0:1790919386.461092:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978114944:12345-0@lo:501: Request processed in 1682us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.461104:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790919386.461298:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978114944:0@lo:501: 00000100:00100000:2.0:1790919386.461347:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115072:0@lo:503: 00000100:00100000:2.0:1790919386.461394:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.461428:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b3c2a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.461441:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115072 00000100:00100000:2.0:1790919386.461447:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115072 00000100:00100000:2.0:1790919386.461487:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919386.461495:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978115072:12345-0@lo:503: 00000100:00100000:2.0:1790919386.463852:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978115072:12345-0@lo:503: Request processed in 2351us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.463865:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919386.464082:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115072:0@lo:503: 00000100:00100000:3.0:1790919386.469506:0:8237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8237:1877914978115200:0@lo:502: 00000100:00100000:3.0:1790919386.469599:0:8237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.469635:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115200 00000100:00100000:3.0:1790919386.469658:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115200 00000100:00100000:3.0:1790919386.469866:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790919386.469877:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:8237:x1877914978115200:12345-0@lo:502: 00000100:00100000:3.0:1790919386.470339:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:8237:x1877914978115200:12345-0@lo:502: Request processed in 463us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.470347:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790919386.470408:0:8237:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.470432:0:8237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8237:1877914978115200:0@lo:502: 00000100:00100000:3.0:1790919386.470490:0:8237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8237:1877914978115328:0@lo:502: 00000100:00100000:3.0:1790919386.470542:0:8237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.470566:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115328 00000100:00100000:3.0:1790919386.470570:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115328 00000100:00100000:3.0:1790919386.470591:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790919386.470596:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:8237:x1877914978115328:12345-0@lo:502: 00000100:00100000:3.0:1790919386.471039:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:8237:x1877914978115328:12345-0@lo:502: Request processed in 441us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.471046:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790919386.471102:0:8237:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.471116:0:8237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8237:1877914978115328:0@lo:502: 00000040:00080000:3.0:1790919386.471139:0:8237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790919386.471194:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790919386.471212:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790919386.471222:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.471232:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919386.471252:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790919386.471255:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f385571800 from 5 10000000:01000000:3.0:1790919386.471258:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790919386.471283:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.471291:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.471300:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919386.471314:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115456:0@lo:101: 00000100:00100000:3.0:1790919386.471343:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.471357:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.471372:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115456 00000100:00100000:3.0:1790919386.471376:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115456 00000100:00100000:3.0:1790919386.471401:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790919386.471408:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978115456:12345-0@lo:101: 00010000:00010000:3.0:1790919386.471417:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919386.471430:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913429 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.471451:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913429 expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.471463:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913429 expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.471482:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696200, rc 0) 00000100:00100000:3.0:1790919386.471527:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978115456:12345-0@lo:101: Request processed in 108us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.471533:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790919386.471545:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115456:0@lo:101: 00010000:00010000:1.0:1790919386.471571:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.471582:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919386.471637:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115584:0@lo:256: 00000100:00100000:1.0:1790919386.471670:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.471692:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.471839:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115584 00000100:00100000:3.0:1790919386.471844:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115584 00000100:00100000:3.0:1790919386.471877:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790919386.471886:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978115584:12345-0@lo:256: 20000000:01000000:3.0:1790919386.472026:0:6438:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790919386.472042:0:6438:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790919386.472045:0:6438:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790919386.472155:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978115584:12345-0@lo:256: Request processed in 271us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.472163:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790919386.473124:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115584:0@lo:256: 10000000:01000000:1.0:1790919386.473174:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919386.473182:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.473191:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919386.473198:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790919386.473200:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790919386.473202:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919386.473223:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.473229:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.473248:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919386.473261:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115712:0@lo:101: 00000100:00100000:1.0:1790919386.473296:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.473323:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386592000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.473336:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115712 00000100:00100000:1.0:1790919386.473341:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115712 00000100:00100000:1.0:1790919386.473368:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790919386.473375:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978115712:12345-0@lo:101: 00010000:00010000:1.0:1790919386.473385:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919386.473395:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913437 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.473410:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913437 expref: 19 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.473419:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913437 expref: 19 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.473426:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166da00, rc 0) 00000100:00100000:1.0:1790919386.473452:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978115712:12345-0@lo:101: Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.473458:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790919386.473488:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115712:0@lo:101: 00010000:00010000:1.0:1790919386.473499:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.474120:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919386.474335:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115840:0@lo:501: 00000100:00100000:1.0:1790919386.474373:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.474400:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386592000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.474415:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115840 00000100:00100000:1.0:1790919386.474420:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115840 00000100:00100000:1.0:1790919386.474448:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790919386.474456:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978115840:12345-0@lo:501: 00000100:00100000:1.0:1790919386.474818:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978115840:12345-0@lo:501: Request processed in 362us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.474827:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790919386.474871:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115840:0@lo:501: 00000100:00100000:1.0:1790919386.474901:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115968:0@lo:503: 00000100:00100000:1.0:1790919386.483450:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.483500:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386592000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.483539:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978115968 00000100:00100000:1.0:1790919386.483546:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978115968 00000100:00100000:1.0:1790919386.483592:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919386.483601:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978115968:12345-0@lo:503: 00000100:00100000:1.0:1790919386.484149:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978115968:12345-0@lo:503: Request processed in 547us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.484157:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919386.484218:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978115968:0@lo:503: 00000100:00100000:1.0:1790919386.491431:0:8239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8239:1877914978116096:0@lo:502: 00000100:00100000:1.0:1790919386.491504:0:8239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.491548:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116096 00000100:00100000:1.0:1790919386.491555:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116096 00000100:00100000:1.0:1790919386.491589:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790919386.491607:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:8239:x1877914978116096:12345-0@lo:502: 00000100:00100000:1.0:1790919386.491870:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:8239:x1877914978116096:12345-0@lo:502: Request processed in 273us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.491878:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790919386.492067:0:8239:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.492088:0:8239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8239:1877914978116096:0@lo:502: 00000020:01000000:1.0:1790919386.492117:0:8239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790919386.492124:0:8239:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790919386.492131:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919386.492133:0:8239:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790919386.492139:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790919386.492144:0:8239:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1790919386.492164:0:8239:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790919386.492167:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919386.492189:0:8239:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95f3bbfd8000) 00000020:00000080:1.0:1790919386.492210:0:8239:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1790919386.492217:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790919386.492282:0:8239:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790919386.492287:0:8239:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790919386.492293:0:8239:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad1591344c 00010000:00080000:1.0:1790919386.492320:0:8239:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f383f2a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919386.492568:0:8239:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:0.0:1790919386.496042:0:7248:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1790919386.506122:0:6452:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1790919386.512873:0:6452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8091:x1877914978114688:12345-0@lo:700: Request processed in 68774us (69418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.512887:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790919386.512951:0:8091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d548a80 x1877914978114688/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.512966:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8091:1877914978114688:0@lo:700: 40000000:02000000:1.0:1790919386.512979:0:8091:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00010000:00010000:2.0:1790919386.524821:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790919386.539040:0:8239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790919386.539078:0:8239:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790919386.539546:0:8239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919386.539731:0:8239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919386.539779:0:8239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790919386.539838:0:8239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790919386.541849:0:8244:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919386.541856:0:8244:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790919386.542768:0:8239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919386.542782:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790919386.542815:0:8239:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790919386.542839:0:8239:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15913453 00000100:00080000:2.0:1790919386.542850:0:8239:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919386.542862:0:8239:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f383f2a800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919386.542898:0:8239:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae84aa00 x1877914978116224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919386.542988:0:8239:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790919386.543066:0:8239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919386.543070:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919386.543072:0:8239:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790919386.543075:0:8239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919386.543079:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919386.543080:0:8239:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790919386.543083:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790919386.543084:0:8239:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790919386.543112:0:8239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8239:1877914978116352:0@lo:502: 00000100:00100000:2.0:1790919386.543193:0:8239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.543235:0:8239:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b3c2a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919386.543251:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978116224:0@lo:8: 00000100:00100000:2.0:1790919386.543280:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.543311:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116352 00000100:00100000:2.0:1790919386.543317:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116352 00000100:00100000:2.0:1790919386.543349:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919386.543357:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:8239:x1877914978116352:12345-0@lo:502: 00000100:00100000:2.0:1790919386.543579:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:8239:x1877914978116352:12345-0@lo:502: Request processed in 221us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.543586:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919386.543625:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116224 00000100:00100000:2.0:1790919386.544122:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116224 00000100:00100000:2.0:1790919386.544193:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919386.544199:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978116224:12345-0@lo:8: 00010000:00080000:2.0:1790919386.544223:0:8084:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1790919386.544250:0:8084:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591345a 00002000:00100000:2.0:1790919386.544263:0:8084:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95f3b6252800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790919386.544267:0:8084:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790919386.544270:0:8084:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790919386.544476:0:8084:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790919386.544605:0:8084:0:(import.c:65:import_set_state_nolock()) ffff95f3b6251800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919386.545009:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978116224:12345-0@lo:8: Request processed in 807us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.545017:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919386.545077:0:8239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8239:1877914978116352:0@lo:502: 00000020:01000000:2.0:1790919386.545112:0:8239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919386.545118:0:8239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919386.545126:0:8239:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790919386.545131:0:8239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:3.0:1790919386.545341:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3ae84aa00 x1877914978116224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919386.545352:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919386.545359:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790919386.545366:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790919386.545379:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790919386.545382:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f2a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:01000000:1.0:1790919386.545383:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000004:00080000:3.0:1790919386.545399:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 10000000:01000000:1.0:1790919386.545402:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1790919386.545404:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978116224:0@lo:8: 00010000:00010000:1.0:1790919386.545411:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.545421:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919386.545431:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919386.545433:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385571800 from 1 10000000:01000000:1.0:1790919386.545436:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919386.545466:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.545473:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.545482:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919386.545508:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978116480:0@lo:101: 00000100:00100000:1.0:1790919386.545558:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.545594:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.545603:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116480 00000004:00080000:1.0:1790919386.545608:0:8244:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1790919386.545609:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116480 00000100:00100000:3.0:1790919386.545644:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790919386.545660:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978116480:12345-0@lo:101: 00010000:00010000:3.0:1790919386.545671:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919386.545683:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913461 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.545706:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913461 expref: 20 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.545716:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913461 expref: 20 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919386.545724:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697800, rc 0) 00000100:00100000:3.0:1790919386.545757:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978116480:12345-0@lo:101: Request processed in 98us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.545763:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:1.0:1790919386.545769:0:8244:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 195573715758ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790919386.545807:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978116480:0@lo:101: 00010000:00010000:1.0:1790919386.545820:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.545829:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919386.545871:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978116608:0@lo:501: 00000100:00100000:1.0:1790919386.545896:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.545919:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.546251:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116608 00000100:00100000:0.0:1790919386.546257:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116608 00000100:00100000:0.0:1790919386.546278:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790919386.546285:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978116608:12345-0@lo:501: 00000100:00100000:0.0:1790919386.546490:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978116608:12345-0@lo:501: Request processed in 204us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.546496:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790919386.546610:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978116608:0@lo:501: 00000100:00100000:3.0:1790919386.546639:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978116736:0@lo:503: 00000100:00100000:3.0:1790919386.546678:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.546706:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.548143:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116736 00000100:00100000:0.0:1790919386.548152:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116736 00000100:00100000:0.0:1790919386.548186:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790919386.548195:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978116736:12345-0@lo:503: 00000100:00100000:0.0:1790919386.548409:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978116736:12345-0@lo:503: Request processed in 215us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.548417:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790919386.548473:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978116736:0@lo:503: 00000100:00100000:2.0:1790919386.550840:0:8246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8246:1877914978116864:0@lo:502: 00000100:00100000:2.0:1790919386.550913:0:8246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.550953:0:8246:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.551725:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116864 00000100:00100000:1.0:1790919386.551736:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116864 00000100:00100000:1.0:1790919386.551780:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790919386.551789:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:8246:x1877914978116864:12345-0@lo:502: 00000100:00100000:1.0:1790919386.552106:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:8246:x1877914978116864:12345-0@lo:502: Request processed in 317us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.552114:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790919386.552177:0:8246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8246:1877914978116864:0@lo:502: 00000020:01000000:1.0:1790919386.552207:0:8246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919386.552217:0:8246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919386.552224:0:8246:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790919386.552233:0:8246:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f385571800 00000020:00000080:1.0:1790919386.552236:0:8246:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919386.552268:0:8246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8246:1877914978116992:0@lo:502: 00000100:00100000:1.0:1790919386.552303:0:8246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.552328:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978116992 00000100:00100000:1.0:1790919386.552332:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978116992 00000100:00100000:1.0:1790919386.552352:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919386.552358:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:8246:x1877914978116992:12345-0@lo:502: 00000100:00100000:1.0:1790919386.552464:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:8246:x1877914978116992:12345-0@lo:502: Request processed in 106us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.552470:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919386.552505:0:8246:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.553830:0:8246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:8246:1877914978116992:0@lo:502: 00000020:01000000:1.0:1790919386.553862:0:8246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919386.553869:0:8246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919386.553871:0:8246:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790919386.553878:0:8246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790919386.558793:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790919386.558830:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919386.558841:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.558854:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919386.558862:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790919386.558864:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f3908ab380 from 1 10000000:01000000:2.0:1790919386.558867:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790919386.558900:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.558909:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919386.559105:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919386.559130:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978117120:0@lo:101: 00000100:00100000:2.0:1790919386.559265:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.559307:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.560785:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117120 00000100:00100000:1.0:1790919386.560796:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117120 00000100:00100000:1.0:1790919386.560847:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790919386.560857:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978117120:12345-0@lo:101: 00010000:00010000:1.0:1790919386.560872:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919386.561117:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591346f expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.561145:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591346f expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.561169:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591346f expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.561178:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c800, rc 0) 00000100:00100000:1.0:1790919386.561462:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978117120:12345-0@lo:101: Request processed in 606us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.561470:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790919386.561708:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978117120:0@lo:101: 00010000:00010000:1.0:1790919386.561725:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.561735:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919386.561796:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978117248:0@lo:501: 00000100:00100000:1.0:1790919386.561828:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.561864:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.562037:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117248 00000100:00100000:0.0:1790919386.562048:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117248 00000100:00100000:0.0:1790919386.562095:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919386.562103:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978117248:12345-0@lo:501: 00000100:00100000:0.0:1790919386.562273:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978117248:12345-0@lo:501: Request processed in 171us (444us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919386.562280:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790919386.562883:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978117248:0@lo:501: 10000000:01000000:1.0:1790919386.562911:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790919386.562987:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919386.563251:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1790919386.569102:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1790919386.569783:0:8091:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8235:x1877914978114304:12345-0@lo:700: Request processed in 126415us (135645us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.569800:0:8091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790919386.569950:0:8235:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514380 x1877914978114304/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919386.569965:0:8235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978114304:0@lo:700: 00000004:00080000:2.0:1790919386.582701:0:8245:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790919386.582733:0:8245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978117504:0@lo:7: 00000100:00100000:2.0:1790919386.582807:0:8245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.582836:0:8245:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1790919386.582862:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1790919386.582882:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978117376:0@lo:13: 00000100:00100000:2.0:1790919386.582909:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919386.583145:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117376 00000100:00100000:0.0:1790919386.583154:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117376 00000100:00100000:0.0:1790919386.583204:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919386.583213:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978117376:12345-0@lo:13: 00002000:00000024:0.0:1790919386.583246:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790919386.583306:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978117376:12345-0@lo:13: Request processed in 94us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.583313:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790919386.583337:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919386.583370:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3ae84a680 x1877914978117376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919386.583389:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978117376:0@lo:13: 00000100:00100000:1.0:1790919386.583600:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117504 00000100:00100000:1.0:1790919386.583605:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117504 00000100:00100000:1.0:1790919386.583641:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919386.583648:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8245:x1877914978117504:12345-0@lo:7: 00000004:00080000:3.0:1790919386.589548:0:8235:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790919386.589578:0:8235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978117760:0@lo:7: 00000100:00100000:3.0:1790919386.589645:0:8235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.589674:0:8235:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1790919386.589694:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919386.589706:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978117632:0@lo:13: 00000100:00100000:3.0:1790919386.589735:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919386.589769:0:8084:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790919386.589776:0:8084:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790919386.589901:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117632 00000100:00100000:3.0:1790919386.589909:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117632 00000100:00100000:3.0:1790919386.589957:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919386.589966:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978117632:12345-0@lo:13: 00002000:00000024:3.0:1790919386.589987:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790919386.590033:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978117632:12345-0@lo:13: Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.590040:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790919386.590100:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d548380 x1877914978117632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919386.590119:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978117632:0@lo:13: 00000100:00100000:3.0:1790919386.590437:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117760 00000100:00100000:3.0:1790919386.590442:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117760 00000100:00100000:0.0:1790919386.590578:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919386.590586:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8235:x1877914978117760:12345-0@lo:7: 00002000:00080000:0.0:1790919386.592439:0:8083:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1790919386.592444:0:8083:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790919386.592600:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8245:x1877914978117504:12345-0@lo:7: Request processed in 8950us (9791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919386.592618:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790919386.592711:0:8245:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3ae849f80 x1877914978117504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919386.592725:0:8245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978117504:0@lo:7: 00000004:00080000:2.0:1790919386.592736:0:8245:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790919386.592769:0:8245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978117888:0@lo:5: 00000100:00100000:2.0:1790919386.592802:0:8245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919386.592861:0:8245:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.592901:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978117888 00000100:00100000:0.0:1790919386.592907:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978117888 00000100:00100000:0.0:1790919386.592977:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919386.592986:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8245:x1877914978117888:12345-0@lo:5: 00002000:00080000:0.0:1790919386.593008:0:8084:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790919386.593011:0:8084:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790919386.593235:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8245:x1877914978117888:12345-0@lo:5: Request processed in 250us (432us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790919386.593241:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790919386.593306:0:8245:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3ae849f80 x1877914978117888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.593318:0:8245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978117888:0@lo:5: 00000004:00080000:1.0:1790919386.593326:0:8245:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790919386.593347:0:8245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978118016:0@lo:700: 00000100:00100000:1.0:1790919386.593372:0:8245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.593388:0:8245:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919386.593393:0:8092:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118016 00000100:00100000:0.0:1790919386.593397:0:8092:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118016 00000100:00100000:0.0:1790919386.593427:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919386.593434:0:8092:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8245:x1877914978118016:12345-0@lo:700: 00002000:00080000:3.0:1790919386.603723:0:8248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1790919386.603731:0:8248:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790919386.603819:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8235:x1877914978117760:12345-0@lo:7: Request processed in 13230us (14170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919386.603829:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790919386.604644:0:8235:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d548e00 x1877914978117760/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.604660:0:8235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978117760:0@lo:7: 00000004:00080000:1.0:1790919386.604674:0:8235:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790919386.604713:0:8235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978118144:0@lo:5: 00000100:00100000:1.0:1790919386.604756:0:8235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.604782:0:8235:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.604802:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118144 00000100:00100000:1.0:1790919386.604807:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118144 00000100:00100000:1.0:1790919386.604850:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919386.604859:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8235:x1877914978118144:12345-0@lo:5: 00002000:00080000:1.0:1790919386.604905:0:8083:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1790919386.605088:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8235:x1877914978118144:12345-0@lo:5: Request processed in 229us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.605096:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790919386.605130:0:8235:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24380 x1877914978118144/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.605139:0:8235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978118144:0@lo:5: 00000004:00080000:1.0:1790919386.605148:0:8235:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790919386.605168:0:8235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978118272:0@lo:5: 00000100:00100000:1.0:1790919386.605195:0:8235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.605211:0:8235:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.605225:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118272 00000100:00100000:1.0:1790919386.605229:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118272 00000100:00100000:1.0:1790919386.605250:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919386.605257:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8235:x1877914978118272:12345-0@lo:5: 00002000:00080000:1.0:1790919386.605284:0:8084:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790919386.614408:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8235:x1877914978118272:12345-0@lo:5: Request processed in 9145us (9210us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790919386.614421:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790919386.615852:0:8235:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24380 x1877914978118272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.615872:0:8235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8235:1877914978118272:0@lo:5: 00000004:00080000:1.0:1790919386.615887:0:8235:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1790919386.615992:0:8235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8235:1877914978118400:0@lo:900: 00000100:00100000:1.0:1790919386.616043:0:8235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.616093:0:8235:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.616118:0:6457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118400 00000100:00100000:1.0:1790919386.616125:0:6457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118400 00000100:00100000:1.0:1790919386.616163:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919386.616171:0:6457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8235:x1877914978118400:12345-0@lo:900: 00000100:00100000:1.0:1790919386.616222:0:6457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8235:x1877914978118400:12345-0@lo:900: Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919386.616240:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790919386.616272:0:8235:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24e00 x1877914978118400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.616284:0:8235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8235:1877914978118400:0@lo:900: 00000001:00080000:1.0:1790919386.659152:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1790919386.659169:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790919386.659338:0:8092:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8245:x1877914978118016:12345-0@lo:700: Request processed in 65900us (65961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919386.659354:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790919386.659627:0:8245:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24700 x1877914978118016/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919386.659639:0:8245:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790919386.659656:0:8245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978118016:0@lo:700: 00000004:02000040:0.0:1790919386.686549:0:8245:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1790919386.689303:0:8245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978118528:0@lo:5: 00000100:00100000:1.0:1790919386.689369:0:8245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919386.689400:0:8245:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919386.689422:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118528 00000100:00100000:1.0:1790919386.689430:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118528 00000100:00100000:1.0:1790919386.689472:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919386.689481:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8245:x1877914978118528:12345-0@lo:5: 00002000:00080000:1.0:1790919386.702672:0:8082:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790919386.702693:0:8082:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1790919386.706506:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8245:x1877914978118528:12345-0@lo:5: Request processed in 17019us (17131us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790919386.706528:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790919386.706618:0:8245:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24700 x1877914978118528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919386.706635:0:8245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8245:1877914978118528:0@lo:5: 00000004:00080000:0.0:1790919386.706649:0:8245:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1790919387.549201:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919388.573487:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919389.596926:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919390.008791:0:8461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790919390.620656:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919391.132450:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919391.132475:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978118656:0@lo:41: 00000100:00100000:2.0:1790919391.132560:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919391.132673:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118656 00000100:00100000:1.0:1790919391.132682:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118656 00000100:00100000:1.0:1790919391.132731:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919391.132741:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978118656:12345-0@lo:41: 00000004:00000024:1.0:1790919391.132795:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919391.132854:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978118656:12345-0@lo:41: Request processed in 115us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919391.132861:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790919391.133086:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978118656:0@lo:41: 00000100:00100000:2.0:1790919391.133597:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978118784:0@lo:41: 00000100:00100000:2.0:1790919391.133648:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919391.134337:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118784 00000100:00100000:3.0:1790919391.134345:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118784 00000100:00100000:3.0:1790919391.134391:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790919391.134400:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978118784:12345-0@lo:41: 00000004:00000024:3.0:1790919391.134647:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919391.134724:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978118784:12345-0@lo:41: Request processed in 324us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919391.134732:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919391.134840:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978118784:0@lo:41: 00010000:00010000:2.0:1790919391.644335:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919391.645069:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919391.645092:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978118912:0@lo:13: 00000100:00100000:3.0:1790919391.645173:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919391.645209:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978118912 00000100:00100000:1.0:1790919391.645219:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978118912 00000100:00080000:3.0:1790919391.645276:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919391.645302:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919391.645313:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3458:x1877914978118912:12345-0@lo:13: 00002000:00000024:1.0:1790919391.645350:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919391.645940:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978119040:0@lo:13: 00000100:00100000:0.0:1790919391.645965:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978119168:0@lo:400: 00000100:00100000:2.0:1790919391.645981:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919391.646009:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919391.646014:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978119552:0@lo:400: 00000100:00100000:0.0:1790919391.646044:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978119680:0@lo:400: 00000100:00100000:2.0:1790919391.646083:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919391.646098:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978119424:0@lo:400: 00000100:00100000:0.0:1790919391.646126:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919391.646152:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790919391.646155:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119552 00000100:00100000:2.0:1790919391.646161:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119552 00000100:00100000:0.0:1790919391.646172:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978119296:0@lo:400: 00000100:00100000:2.0:1790919391.646204:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119424 00000100:00100000:0.0:1790919391.646205:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919391.646210:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119424 00000100:00100000:2.0:1790919391.646227:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119296 00000100:00100000:2.0:1790919391.646231:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119296 00000100:00100000:0.0:1790919391.646232:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978119808:0@lo:400: 00000100:00100000:2.0:1790919391.646258:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919391.646264:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919391.646270:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978119552:12345-0@lo:400: 00000100:00100000:2.0:1790919391.646319:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978119552:12345-0@lo:400: Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919391.646326:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919391.646343:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919391.646349:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978119424:12345-0@lo:400: 00000100:00100000:3.0:1790919391.646623:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919391.646632:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978119296:12345-0@lo:400: 00000100:00100000:3.0:1790919391.647920:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978119296:12345-0@lo:400: Request processed in 1284us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919391.647932:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919391.647968:0:8087:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1790919391.647976:0:8087:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00010000:00080000:0.0:1790919391.648027:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391516d80 x1877914978119296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919391.648044:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978119296:0@lo:400: 00000100:00100000:3.0:1790919391.648162:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919391.648204:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119680 00000100:00100000:3.0:1790919391.648210:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119680 00000100:00100000:3.0:1790919391.648246:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919391.648254:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978119680:12345-0@lo:400: 00000100:00100000:3.0:1790919391.648302:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978119680:12345-0@lo:400: Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919391.648308:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1790919391.648456:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514a80 x1877914978119680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919391.648466:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978119680:0@lo:400: 00000100:00100000:3.0:1790919391.648516:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119808 00000100:00100000:3.0:1790919391.648527:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119808 00000100:00100000:3.0:1790919391.648559:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919391.648566:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978119808:12345-0@lo:400: 00000100:00100000:3.0:1790919391.648644:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978119808:12345-0@lo:400: Request processed in 78us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919391.648650:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790919391.648670:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919391.648674:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919391.648677:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790919391.648798:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391515f80 x1877914978119552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919391.648809:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978119552:0@lo:400: 00000100:00100000:3.0:1790919391.648841:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119040 00000100:00100000:3.0:1790919391.648845:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119040 00000100:00100000:3.0:1790919391.648917:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919391.648924:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978119040:12345-0@lo:13: 00002000:00000024:3.0:1790919391.648938:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919391.648975:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978119040:12345-0@lo:13: Request processed in 52us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919391.648981:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790919391.649003:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391516300 x1877914978119040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919391.649018:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978119040:0@lo:13: 00010000:00080000:3.0:1790919391.649380:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514380 x1877914978119808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919391.649390:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978119808:0@lo:400: 00000100:00100000:0.0:1790919391.650081:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119168 00000100:00100000:0.0:1790919391.650089:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119168 00000100:00100000:0.0:1790919391.650124:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919391.650132:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3461:x1877914978119168:12345-0@lo:400: 00000100:00100000:0.0:1790919391.650232:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3461:x1877914978119168:12345-0@lo:400: Request processed in 100us (4222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919391.650239:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919391.651396:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978119168:0@lo:400: 00000100:00100000:2.0:1790919391.655875:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978119424:12345-0@lo:400: Request processed in 9516us (9739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919391.655892:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790919391.655962:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391514e00 x1877914978119424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919391.655978:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978119424:0@lo:400: 00000100:00100000:1.0:1790919391.659870:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3458:x1877914978118912:12345-0@lo:13: Request processed in 14552us (14689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919391.659884:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790919391.659939:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24a80 x1877914978118912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919391.659966:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978118912:0@lo:13: 00000001:00080000:1.0:1790919391.736343:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1790919391.736361:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790919392.669680:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919393.692283:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919394.717215:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919395.740295:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919396.253377:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978119936:0@lo:41: 00000100:00100000:2.0:1790919396.253454:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.253525:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978119936 00000100:00100000:2.0:1790919396.253532:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978119936 00000100:00100000:2.0:1790919396.253576:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919396.253585:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978119936:12345-0@lo:41: 00000004:00000024:2.0:1790919396.253623:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790919396.253668:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978119936:12345-0@lo:41: Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.253680:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919396.253735:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978119936:0@lo:41: 00000100:00100000:0.0:1790919396.259770:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919396.259855:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978120064:0@lo:41: 00000100:00100000:0.0:1790919396.259926:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919396.261001:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120064 00000100:00100000:3.0:1790919396.261012:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120064 00000100:00100000:3.0:1790919396.261089:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790919396.261099:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978120064:12345-0@lo:41: 00000004:00000024:3.0:1790919396.261137:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919396.261200:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978120064:12345-0@lo:41: Request processed in 102us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919396.261207:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790919396.261257:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978120064:0@lo:41: 00010000:00010000:0.0:1790919396.764807:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919396.766393:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978120576:0@lo:400: 00000100:00100000:2.0:1790919396.766480:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.766534:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790919396.766541:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978120192:0@lo:400: 00000100:00100000:2.0:1790919396.766568:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.766588:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978120704:0@lo:400: 00000100:00100000:2.0:1790919396.766614:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.766639:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978120448:0@lo:400: 00000100:00100000:2.0:1790919396.766663:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.766679:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978120960:0@lo:400: 00000100:00100000:2.0:1790919396.766701:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.766717:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790919396.766737:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978120320:0@lo:400: 00000100:00100000:2.0:1790919396.766771:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.766786:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978120832:0@lo:400: 00000100:00100000:2.0:1790919396.767948:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.768009:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120576 00000100:00100000:2.0:1790919396.768017:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120576 00000100:00100000:2.0:1790919396.768085:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120704 00000100:00100000:2.0:1790919396.768088:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120704 00000100:00100000:2.0:1790919396.768104:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120448 00000100:00100000:2.0:1790919396.768108:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120448 00000100:00100000:2.0:1790919396.768117:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120320 00000100:00100000:2.0:1790919396.768120:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120320 00000100:00100000:2.0:1790919396.768133:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919396.768141:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978120576:12345-0@lo:400: 00000100:00100000:2.0:1790919396.768203:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978120576:12345-0@lo:400: Request processed in 62us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.768210:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919396.768227:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919396.768233:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978120704:12345-0@lo:400: 00000100:00100000:2.0:1790919396.768261:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978120704:12345-0@lo:400: Request processed in 29us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.768267:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919396.768277:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919396.768281:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978120448:12345-0@lo:400: 00000100:00100000:2.0:1790919396.768309:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978120448:12345-0@lo:400: Request processed in 28us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.768314:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919396.768324:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919396.768340:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978120320:12345-0@lo:400: 00000100:00100000:2.0:1790919396.768369:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978120320:12345-0@lo:400: Request processed in 30us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.768374:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919396.768402:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120960 00000100:00100000:2.0:1790919396.768406:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120960 00000100:00100000:2.0:1790919396.768429:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120832 00000100:00100000:2.0:1790919396.768432:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120832 00000100:00100000:2.0:1790919396.768461:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919396.768467:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978120960:12345-0@lo:400: 00000100:00100000:2.0:1790919396.768497:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978120960:12345-0@lo:400: Request processed in 30us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.768503:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919396.768512:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919396.768517:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978120832:12345-0@lo:400: 00000100:00100000:2.0:1790919396.768542:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978120832:12345-0@lo:400: Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.768547:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790919396.768561:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919396.768565:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919396.768567:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790919396.768603:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398daa680 x1877914978120704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.768617:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978120704:0@lo:400: 00010000:00080000:2.0:1790919396.768629:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398dabb80 x1877914978120576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.768638:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978120576:0@lo:400: 00010000:00080000:2.0:1790919396.768677:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da9880 x1877914978120320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.768686:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978120320:0@lo:400: 00010000:00080000:2.0:1790919396.768695:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da9500 x1877914978120832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.768701:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790919396.768711:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978120832:0@lo:400: 00010000:00080000:2.0:1790919396.768722:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398dab100 x1877914978120448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.768729:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978120448:0@lo:400: 00010000:00080000:2.0:1790919396.768740:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da8380 x1877914978120960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.768747:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1790919396.768754:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978120960:0@lo:400: 00000100:00100000:0.0:1790919396.768905:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978120192 00000100:00100000:0.0:1790919396.768909:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978120192 00000100:00100000:0.0:1790919396.768932:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919396.768938:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3460:x1877914978120192:12345-0@lo:400: 00000100:00100000:0.0:1790919396.768975:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3460:x1877914978120192:12345-0@lo:400: Request processed in 37us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919396.768987:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919396.769038:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978120192:0@lo:400: 00000100:00100000:2.0:1790919396.770682:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919396.770703:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978121088:0@lo:13: 00000100:00100000:2.0:1790919396.770770:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919396.770822:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121088 00000100:00100000:2.0:1790919396.770828:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121088 00000100:00100000:2.0:1790919396.770864:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919396.770872:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978121088:12345-0@lo:13: 00002000:00000024:2.0:1790919396.770901:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919396.770936:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978121088:12345-0@lo:13: Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919396.770955:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790919396.770989:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da8380 x1877914978121088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919396.771005:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978121088:0@lo:13: 00000100:00100000:1.0:1790919396.771173:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919396.771183:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978121216:0@lo:13: 00000100:00100000:1.0:1790919396.771210:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919396.771235:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121216 00000100:00100000:1.0:1790919396.771238:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121216 00000100:00100000:1.0:1790919396.771259:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919396.771264:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978121216:12345-0@lo:13: 00002000:00000024:1.0:1790919396.771274:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919396.771300:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978121216:12345-0@lo:13: Request processed in 36us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919396.771312:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790919396.771338:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24a80 x1877914978121216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919396.771350:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978121216:0@lo:13: 00010000:00010000:1.0:1790919397.793393:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919398.812256:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919399.837237:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790919400.209528:0:9028:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790919400.209532:0:9028:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790919400.209666:0:9028:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f3a6ada000 00000020:01000004:2.0:1790919400.209683:0:9028:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790919400.209697:0:9028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790919400.209711:0:9028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95f3a68b99c0) 00000020:00000080:2.0:1790919400.209925:0:9028:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790919400.228682:0:9028:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790919400.229259:0:9028:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790919400.251902:0:9028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790919400.257296:0:9028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790919400.257332:0:9028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790919400.257390:0:9028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790919400.257424:0:9028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790919400.257897:0:9028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790919400.257910:0:9028:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790919400.257919:0:9028:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x951c50ad15913484 00000020:01000004:2.0:1790919400.257925:0:9028:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790919400.257944:0:9028:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790919400.257947:0:9028:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790919400.257953:0:9028:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790919400.257972:0:9028:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790919400.257975:0:9028:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790919400.276890:0:9028:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790919400.276936:0:9028:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1790919400.276940:0:9028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790919400.276942:0:9028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790919400.276943:0:9028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919400.276944:0:9028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919400.276946:0:9028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919400.276947:0:9028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919400.276949:0:9028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919400.276951:0:9028:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919400.276952:0:9028:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919400.276954:0:9028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919400.276955:0:9028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919400.276959:0:9028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1790919400.276962:0:9028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919400.276963:0:9028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790919400.276964:0:9028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919400.276965:0:9028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919400.276966:0:9028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919400.276967:0:9028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919400.276968:0:9028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790919400.276969:0:9028:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790919400.276970:0:9028:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790919400.276971:0:9028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919400.276972:0:9028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919400.277004:0:9028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790919400.277022:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978121344:0@lo:253: 00000100:00100000:3.0:1790919400.277265:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919400.277366:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6272240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919400.277422:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121344 00000100:00100000:0.0:1790919400.277430:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121344 00000100:00100000:0.0:1790919400.277535:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790919400.277545:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9028:x1877914978121344:12345-0@lo:253: 20000000:01000000:0.0:1790919400.277576:0:6438:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790919400.277582:0:6438:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790919400.277587:0:6438:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790919400.277590:0:6438:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1790919400.278665:0:6438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919400.278860:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1790919400.278875:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1790919400.278913:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1790919400.278921:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1790919400.278951:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1790919400.279020:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1790919400.279981:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1790919400.280006:0:6438:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:0.0:1790919400.280008:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1790919400.280043:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1790919400.280285:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790919400.280347:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1790919400.280356:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790919400.280389:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1790919400.280398:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790919400.280443:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1790919400.280498:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1790919400.280992:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1790919400.284786:0:6438:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:0.0:1790919400.284792:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1790919400.284914:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1790919400.284925:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790919400.285004:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1790919400.285012:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790919400.285046:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1790919400.285329:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790919400.285371:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1790919400.285438:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1790919400.286493:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1790919400.286514:0:6438:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:0.0:1790919400.286516:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1790919400.286551:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1790919400.286559:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790919400.286590:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1790919400.286597:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1790919400.286626:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1790919400.286635:0:6438:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790919400.286685:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1790919400.286801:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1790919400.286880:0:6438:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1790919400.286883:0:6438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1790919400.286889:0:6438:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790919400.286891:0:6438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790919400.286893:0:6438:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790919400.286905:0:6438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790919400.286908:0:6438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790919400.286945:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790919400.286948:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919400.288012:0:9030:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919400.288097:0:9030:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919400.288240:0:9030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1790919400.288552:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1790919400.288597:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1790919400.288644:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1790919400.288655:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790919400.288657:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790919400.292243:0:9031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1790919400.292641:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1790919400.292690:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1790919400.292914:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1790919400.292929:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790919400.292931:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919400.293613:0:9032:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919400.293666:0:9032:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919400.293809:0:9032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1790919400.294258:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1790919400.294312:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1790919400.294344:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1790919400.294354:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790919400.294356:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919400.295660:0:9033:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919400.295762:0:9033:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919400.295832:0:9033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790919400.296389:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790919400.296448:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1790919400.296510:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1790919400.296523:0:6438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790919400.296525:0:6438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790919400.297471:0:9034:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1790919400.297526:0:9034:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1790919400.297582:0:9034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1790919400.297962:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1790919400.298019:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1790919400.298290:0:6438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1790919400.298313:0:6438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790919400.298333:0:6438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298353:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591335e expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298361:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913388 expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298368:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159133c7 expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298374:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159133e3 expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298381:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591341b expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298388:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913437 expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298394:0:6438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591346f expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298402:0:6438:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298456:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591346f expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298483:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591346f expref: 21 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.298500:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978121472:0@lo:104: 00000100:00100000:2.0:1790919400.298569:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919400.298657:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913437 expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298666:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913437 expref: 21 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.298674:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978121600:0@lo:104: 00000100:00100000:2.0:1790919400.298697:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919400.298915:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591341b expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.298924:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591341b expref: 21 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.298933:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398daa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978121728:0@lo:104: 00000100:00100000:2.0:1790919400.298970:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919400.299043:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121472 00000100:00100000:3.0:1790919400.299081:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121472 00000100:00100000:3.0:1790919400.299122:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121600 00000100:00100000:3.0:1790919400.299125:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121600 00000100:00100000:3.0:1790919400.299152:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919400.299160:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978121472:12345-0@lo:104: 00010000:00010000:3.0:1790919400.299173:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.299221:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919400.299227:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978121472:12345-0@lo:104: Request processed in 68us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.299234:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919400.299260:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790919400.299265:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978121600:12345-0@lo:104: 00010000:00010000:3.0:1790919400.299273:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.299315:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919400.299320:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978121600:12345-0@lo:104: Request processed in 56us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.299326:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1790919400.299456:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919400.299463:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299471:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919400.299475:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299483:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919400.299490:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919400.299507:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919400.299548:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299555:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919400.299573:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299580:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad1591346f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913476 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299594:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919400.299598:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299604:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ce00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919400.299606:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299612:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919400.299618:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919400.299623:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919400.299635:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299640:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919400.299652:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299659:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15913437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591343e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.299669:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919400.299671:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919400.299673:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919400.299686:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978121856:0@lo:103: 00000100:00100000:0.0:1790919400.299715:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.299759:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919400.299764:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978121984:0@lo:103: 00000100:00100000:0.0:1790919400.299783:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.299806:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121856 00000100:00100000:0.0:1790919400.299809:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121856 00010000:00010000:0.0:1790919400.299951:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591346f expref: 22 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.299970:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121984 00000100:00100000:0.0:1790919400.299973:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121984 00010000:00010000:0.0:1790919400.299982:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913437 expref: 23 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.299997:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919400.300002:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3458:x1877914978121856:12345-0@lo:103: 00010000:00010000:0.0:1790919400.300011:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919400.300015:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591346f expref: 23 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.300034:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591346f expref: 23 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.300048:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919400.300104:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3458:x1877914978121856:12345-0@lo:103: Request processed in 102us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.300111:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919400.300123:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919400.300138:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3458:x1877914978121984:12345-0@lo:103: 00010000:00010000:0.0:1790919400.300144:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919400.300148:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913437 expref: 22 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.300156:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913437 expref: 22 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.300164:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919400.300183:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3458:x1877914978121984:12345-0@lo:103: Request processed in 55us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.300188:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919400.300225:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978121984:0@lo:103: 00000100:00100000:0.0:1790919400.300232:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978121856:0@lo:103: 00010000:00010000:2.0:1790919400.300600:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.300636:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159133e3 expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.300647:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159133e3 expref: 21 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.300657:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122112:0@lo:104: 00000100:00100000:2.0:1790919400.300692:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919400.300710:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159133c7 expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.300718:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159133c7 expref: 21 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919400.300806:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978121728 00000100:00100000:3.0:1790919400.300822:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978121728 00000100:00100000:3.0:1790919400.300845:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122112 00000100:00100000:3.0:1790919400.300847:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122112 00000100:00100000:3.0:1790919400.300857:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919400.300863:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978121728:12345-0@lo:104: 00010000:00010000:3.0:1790919400.300873:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.300923:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919400.300928:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978121728:12345-0@lo:104: Request processed in 66us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.300933:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919400.300946:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919400.300952:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978122112:12345-0@lo:104: 00010000:00010000:3.0:1790919400.300959:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.300991:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919400.301003:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978122112:12345-0@lo:104: Request processed in 51us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.301008:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1790919400.301025:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919400.301030:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301035:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204bc00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919400.301039:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301046:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919400.301076:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919400.301082:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919400.301105:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301111:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919400.301140:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301146:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204bc00/0x951c50ad1591341b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913422 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301158:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919400.301161:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301176:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ba00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919400.301179:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301185:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919400.301191:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919400.301195:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919400.301208:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301214:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919400.301219:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301225:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204ba00/0x951c50ad159133e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133ea expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.301235:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919400.301236:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919400.301238:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919400.301254:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978122368:0@lo:103: 00000100:00100000:3.0:1790919400.301294:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919400.301323:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919400.301329:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978122496:0@lo:103: 00000100:00100000:3.0:1790919400.301360:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919400.301386:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122368 00000100:00100000:3.0:1790919400.301390:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122368 00010000:00010000:3.0:1790919400.301405:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591341b expref: 22 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919400.301435:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122496 00000100:00100000:3.0:1790919400.301438:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122496 00010000:00010000:3.0:1790919400.301449:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159133e3 expref: 23 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919400.301465:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919400.301471:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3460:x1877914978122368:12345-0@lo:103: 00010000:00010000:3.0:1790919400.301479:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919400.301483:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591341b expref: 23 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.301534:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919400.301761:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122240:0@lo:104: 00000100:00100000:2.0:1790919400.301781:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919400.301790:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3460:x1877914978122496:12345-0@lo:103: 00010000:00010000:2.0:1790919400.301798:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919400.301803:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159133e3 expref: 23 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.302036:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591341b expref: 23 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.302301:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919400.302341:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3460:x1877914978122368:12345-0@lo:103: Request processed in 869us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.302349:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919400.302465:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978122368:0@lo:103: 00010000:00010000:2.0:1790919400.302537:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159133e3 expref: 22 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.302547:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919400.302581:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3460:x1877914978122496:12345-0@lo:103: Request processed in 793us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.302588:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919400.302644:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919400.302687:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913388 expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.302697:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913388 expref: 21 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.302706:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122624:0@lo:104: 00000100:00100000:0.0:1790919400.302797:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122240 00000100:00100000:0.0:1790919400.302802:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122240 00000100:00100000:0.0:1790919400.302840:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790919400.302847:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978122240:12345-0@lo:104: 00010000:00010000:0.0:1790919400.302861:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.302901:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919400.302907:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978122240:12345-0@lo:104: Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.302913:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1790919400.303006:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919400.303012:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303019:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919400.303022:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303029:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919400.303035:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919400.303040:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919400.303100:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303106:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919400.303121:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303127:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204b800/0x951c50ad159133c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133ce expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303148:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.303149:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.303151:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919400.303157:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919400.303167:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978122752:0@lo:103: 00000100:00100000:2.0:1790919400.303191:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.303222:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122752 00000100:00100000:2.0:1790919400.303226:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122752 00010000:00010000:2.0:1790919400.303241:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159133c7 expref: 22 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303258:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919400.303263:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3459:x1877914978122752:12345-0@lo:103: 00010000:00010000:2.0:1790919400.303270:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919400.303273:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159133c7 expref: 22 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303280:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159133c7 expref: 22 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303289:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919400.303311:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3459:x1877914978122752:12345-0@lo:103: Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.303316:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919400.303340:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978122752:0@lo:103: 00000100:00100000:2.0:1790919400.303373:0:6438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919400.303391:0:6438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591335e expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.303399:0:6438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591335e expref: 21 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303407:0:6438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122880:0@lo:104: 00000100:00100000:2.0:1790919400.303435:0:6438:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790919400.303447:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166c800/0x951c50ad15913476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591346f expref: 21 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303467:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978121472:0@lo:104: 00010000:00010000:2.0:1790919400.303479:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166da00/0x951c50ad1591343e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913437 expref: 20 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303487:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978121600:0@lo:104: 00010000:00010000:2.0:1790919400.303496:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204b600/0x951c50ad15913422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591341b expref: 19 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303503:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398daa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978121728:0@lo:104: 00010000:00010000:2.0:1790919400.303512:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166d800/0x951c50ad159133ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159133e3 expref: 18 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303518:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122112:0@lo:104: 00010000:00010000:2.0:1790919400.303525:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166de00/0x951c50ad159133ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159133c7 expref: 17 pid: 6440 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.303532:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122240:0@lo:104: 00000100:00100000:0.0:1790919400.303656:0:6429:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790919400.303672:0:6429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.303694:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122624 00000100:00100000:0.0:1790919400.303698:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122624 00000100:00100000:0.0:1790919400.303713:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978122880 00000100:00100000:0.0:1790919400.303716:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978122880 00000100:00100000:0.0:1790919400.303738:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919400.303744:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978122624:12345-0@lo:104: 00010000:00010000:0.0:1790919400.303751:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.303789:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919400.303794:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6438:x1877914978122624:12345-0@lo:104: Request processed in 51us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.303800:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919400.303953:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919400.303960:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978122880:12345-0@lo:104: 00010000:00010000:0.0:1790919400.303967:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304002:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790919400.304014:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6438:x1877914978122880:12345-0@lo:104: Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.304020:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790919400.304036:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919400.304041:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304048:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919400.304073:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304080:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919400.304086:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919400.304092:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919400.304114:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304120:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919400.304195:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304203:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591338f expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304212:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919400.304215:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304232:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919400.304235:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304242:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919400.304248:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919400.304253:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919400.304268:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304274:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919400.304281:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304287:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f38166ca00/0x951c50ad1591335e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913365 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304298:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919400.304300:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919400.304301:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919400.304311:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919400.304372:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978123136:0@lo:103: 00000100:00100000:1.0:1790919400.304405:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919400.304454:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978122496:0@lo:103: 00000100:00100000:0.0:1790919400.304508:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123136 00000100:00100000:0.0:1790919400.304513:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123136 00010000:00010000:0.0:1790919400.304527:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591335e expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.304564:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919400.304572:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3460:x1877914978123136:12345-0@lo:103: 00010000:00010000:0.0:1790919400.304581:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919400.304586:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591335e expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304594:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591335e expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.304606:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919400.304636:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3460:x1877914978123136:12345-0@lo:103: Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.304642:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919400.304667:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978123136:0@lo:103: 00000100:00100000:2.0:1790919400.304914:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978123008:0@lo:103: 00000100:00100000:2.0:1790919400.304942:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.304996:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122624:0@lo:104: 00010000:00010000:2.0:1790919400.305007:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697200/0x951c50ad15913365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591335e expref: 16 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.305017:0:6438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6438:1877914978122880:0@lo:104: 00010000:00010000:2.0:1790919400.305046:0:6438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.305198:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123008 00000100:00100000:0.0:1790919400.305203:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123008 00010000:00010000:0.0:1790919400.305219:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913388 expref: 16 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.305247:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919400.305254:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3459:x1877914978123008:12345-0@lo:103: 00010000:00010000:0.0:1790919400.305262:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919400.305265:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913388 expref: 16 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305275:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913388 expref: 16 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305295:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166c600/0x951c50ad1591338f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913388 expref: 16 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305308:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305317:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305331:0:6431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305338:0:6431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305345:0:6431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305352:0:6431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305357:0:6431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204be00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919400.305362:0:6431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305370:0:6431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305382:0:6431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.305401:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919400.305444:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3459:x1877914978123008:12345-0@lo:103: Request processed in 190us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.305451:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919400.305512:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978123008:0@lo:103: 00010000:00010000:1.0:1790919400.305575:0:6438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.305584:0:6438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.305590:0:6438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204be00/0x951c50ad1591348b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790919400.305603:0:6438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790919400.372857:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:9028:x1877914978121344:12345-0@lo:253: Request processed in 95305us (95584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.372871:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790919400.372979:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978121344:0@lo:253: 10000000:01000000:0.0:1790919400.373007:0:9028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790919400.373011:0:9028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919400.373013:0:9028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790919400.373015:0:9028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919400.373016:0:9028:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790919400.373018:0:9028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919400.373019:0:9028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919400.373021:0:9028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790919400.373022:0:9028:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790919400.373024:0:9028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919400.373026:0:9028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790919400.373048:0:9028:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3a6ada000 from lustre-OST0001 10000000:01000000:0.0:1790919400.373095:0:9028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790919400.373098:0:9028:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790919400.373108:0:9028:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f3908ab380 local copy 10000000:01000000:0.0:1790919400.373112:0:9028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790919400.373160:0:9028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.373172:0:9028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.373190:0:9028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.373208:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123264:0@lo:101: 00000100:00100000:0.0:1790919400.373254:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.373297:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919400.373518:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123264 00000100:00100000:1.0:1790919400.373524:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123264 00000100:00100000:1.0:1790919400.373602:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790919400.373612:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+14:9028:x1877914978123264:12345-0@lo:101: 00010000:00010000:1.0:1790919400.373625:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919400.373643:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6486200/0x951c50ad15913499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913492 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.373673:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6486200/0x951c50ad15913499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913492 expref: 15 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.373683:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6486200/0x951c50ad15913499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913492 expref: 15 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.373691:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486200, rc 0) 00000100:00100000:1.0:1790919400.373735:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123264:12345-0@lo:101: Request processed in 125us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.373741:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790919400.373805:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123264:0@lo:101: 00010000:00010000:0.0:1790919400.373817:0:9028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.373825:0:9028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.373914:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123392:0@lo:501: 00000100:00100000:0.0:1790919400.373940:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.374044:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.374108:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123392 00000100:00100000:2.0:1790919400.374113:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123392 00000100:00100000:2.0:1790919400.374328:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790919400.374337:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123392:12345-0@lo:501: 00000100:00100000:2.0:1790919400.374631:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123392:12345-0@lo:501: Request processed in 295us (689us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919400.374639:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790919400.374752:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123392:0@lo:501: 10000000:01000000:0.0:1790919400.374767:0:9028:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790919400.374796:0:9028:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790919400.374802:0:9028:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.374810:0:9028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.374818:0:9028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.374874:0:9028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790919400.374899:0:9028:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3a6ada000 10000000:01000000:0.0:1790919400.374903:0:9028:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919400.374908:0:9028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790919400.374918:0:9028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919400.374922:0:9028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790919400.374925:0:9028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790919400.374945:0:9028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.374952:0:9028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.374961:0:9028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.374975:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123520:0@lo:101: 00000100:00100000:0.0:1790919400.375004:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.375041:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919400.375137:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123520 00000100:00100000:3.0:1790919400.375142:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123520 00000100:00100000:3.0:1790919400.375211:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790919400.375219:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123520:12345-0@lo:101: 00010000:00010000:3.0:1790919400.375228:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919400.375245:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159134a0 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.375263:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159134a0 expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.375272:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159134a0 expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.375278:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2ce00, rc 0) 00000100:00100000:3.0:1790919400.375321:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978123520:12345-0@lo:101: Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.375327:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790919400.375394:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123520:0@lo:101: 00010000:00010000:1.0:1790919400.375406:0:9028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.375425:0:9028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919400.375493:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123648:0@lo:501: 00000100:00100000:1.0:1790919400.375532:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919400.375673:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919400.375679:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.375686:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919400.375690:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.375698:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919400.375705:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919400.375710:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919400.375728:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.375740:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919400.375758:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.375765:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014400/0x951c50ad15913492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x951c50ad15913499 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.375779:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.375780:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.375782:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919400.375792:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978123776:0@lo:103: 00000100:00100000:2.0:1790919400.375820:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.375860:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123776 00000100:00100000:2.0:1790919400.375865:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123776 00000100:00100000:2.0:1790919400.375895:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919400.375901:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3461:x1877914978123776:12345-0@lo:103: 00010000:00010000:2.0:1790919400.375910:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919400.375920:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6486200/0x951c50ad15913499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913492 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.375930:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919400.375959:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3461:x1877914978123776:12345-0@lo:103: Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.375965:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919400.375988:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978123776:0@lo:103: 00000100:00100000:1.0:1790919400.376099:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919400.376293:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123648 00000100:00100000:0.0:1790919400.376297:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123648 00000100:00100000:0.0:1790919400.376316:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790919400.376321:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123648:12345-0@lo:501: 00000100:00100000:0.0:1790919400.376581:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123648:12345-0@lo:501: Request processed in 259us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.376588:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790919400.376919:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123648:0@lo:501: 00000100:00100000:1.0:1790919400.376954:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123904:0@lo:503: 00000100:00100000:1.0:1790919400.376996:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919400.377084:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919400.377420:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978123904 00000100:00100000:0.0:1790919400.377426:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978123904 00000100:00100000:1.0:1790919400.377571:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790919400.377579:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123904:12345-0@lo:503: 00000100:00100000:1.0:1790919400.377768:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978123904:12345-0@lo:503: Request processed in 188us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.377775:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790919400.377847:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978123904:0@lo:503: 00000040:00080000:0.0:1790919400.378158:0:9028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919400.378219:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124032:0@lo:502: 00000100:00100000:0.0:1790919400.378258:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.378437:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919400.378584:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124032 00000100:00100000:3.0:1790919400.378590:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124032 00000100:00100000:3.0:1790919400.378616:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790919400.378623:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978124032:12345-0@lo:502: 00000100:00100000:3.0:1790919400.378855:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978124032:12345-0@lo:502: Request processed in 232us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.378862:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790919400.378959:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124032:0@lo:502: 00000040:00080000:0.0:1790919400.379301:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790919400.379353:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790919400.379393:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790919400.379456:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790919400.379497:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790919400.379535:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790919400.379561:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124160:0@lo:502: 00000100:00100000:0.0:1790919400.379602:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.379691:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.379768:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124160 00000100:00100000:2.0:1790919400.379773:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124160 00000100:00100000:3.0:1790919400.379850:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790919400.379858:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978124160:12345-0@lo:502: 00000100:00100000:3.0:1790919400.380034:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978124160:12345-0@lo:502: Request processed in 176us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.380041:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790919400.380284:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124160:0@lo:502: 00000040:00080000:0.0:1790919400.380388:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790919400.380399:0:9028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1790919400.380917:0:9037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790919400.380925:0:9037:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790919400.380931:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919400.380934:0:9037:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790919400.380940:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919400.380954:0:9037:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95f3bbfd99c0) 00000020:00000080:1.0:1790919400.380977:0:9037:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790919400.380984:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790919400.381035:0:9037:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3a6ada000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790919400.381043:0:9037:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790919400.381048:0:9037:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x951c50ad159134b5 00010000:00010000:1.0:1790919400.384816:0:9037:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1790919400.385496:0:9037:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790919400.388222:0:9037:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790919400.388549:0:9037:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790919400.393807:0:9037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1790919400.395431:0:9037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790919400.396648:0:9037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790919400.396658:0:9037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919400.396664:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919400.396666:0:9037:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790919400.396669:0:9037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919400.396672:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919400.396673:0:9037:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790919400.396676:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790919400.396678:0:9037:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790919400.396722:0:9037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919400.396725:0:9037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919400.396732:0:9037:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790919400.396735:0:9037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790919400.397981:0:9028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1790919400.398012:0:9028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790919400.398039:0:9028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.398076:0:9028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919400.398084:0:9028:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3a6ada000 from 1 10000000:01000000:3.0:1790919400.398087:0:9028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919400.398122:0:9028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.398138:0:9028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.398148:0:9028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919400.398169:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124288:0@lo:101: 00000100:00100000:3.0:1790919400.398232:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919400.398272:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919400.398421:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124288 00000100:00100000:1.0:1790919400.398429:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124288 00000100:00100000:1.0:1790919400.398472:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790919400.398481:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978124288:12345-0@lo:101: 00010000:00010000:1.0:1790919400.398495:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919400.398506:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159134bc expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.398529:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159134bc expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.398539:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159134bc expref: 16 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919400.398547:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487a00, rc 0) 00000100:00100000:1.0:1790919400.398587:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124288:12345-0@lo:101: Request processed in 108us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.398594:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790919400.398731:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124288:0@lo:101: 00010000:00010000:3.0:1790919400.398747:0:9028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.398755:0:9028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919400.398923:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124416:0@lo:501: 00000100:00100000:3.0:1790919400.398951:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919400.398977:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919400.399379:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124416 00000100:00100000:1.0:1790919400.399384:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124416 00000100:00100000:1.0:1790919400.399423:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790919400.399430:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124416:12345-0@lo:501: 00000100:00100000:1.0:1790919400.399640:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124416:12345-0@lo:501: Request processed in 210us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.399647:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790919400.399753:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124416:0@lo:501: 00000100:00100000:0.0:1790919400.399782:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124544:0@lo:503: 00000100:00100000:0.0:1790919400.399886:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.399913:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919400.399960:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124544 00000100:00100000:3.0:1790919400.399964:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124544 00000100:00100000:3.0:1790919400.399993:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790919400.399999:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124544:12345-0@lo:503: 00000100:00100000:3.0:1790919400.400535:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124544:12345-0@lo:503: Request processed in 535us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.400542:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790919400.404017:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124544:0@lo:503: 00000040:00080000:0.0:1790919400.404382:0:9028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919400.404474:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124672:0@lo:502: 00000100:00100000:0.0:1790919400.404536:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.404571:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.404681:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124672 00000100:00100000:2.0:1790919400.404687:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124672 00000100:00100000:2.0:1790919400.404728:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790919400.404736:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124672:12345-0@lo:502: 00000100:00100000:2.0:1790919400.405049:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124672:12345-0@lo:502: Request processed in 313us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.405080:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790919400.405276:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124672:0@lo:502: 00000040:00080000:0.0:1790919400.405522:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790919400.405573:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790919400.405599:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124800:0@lo:502: 00000100:00100000:0.0:1790919400.405644:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.405679:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.405765:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124800 00000100:00100000:2.0:1790919400.405770:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124800 00000100:00100000:2.0:1790919400.405837:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790919400.405846:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124800:12345-0@lo:502: 00000100:00100000:2.0:1790919400.405990:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124800:12345-0@lo:502: Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.405996:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790919400.406081:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124800:0@lo:502: 00000040:00080000:0.0:1790919400.406177:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790919400.406187:0:9028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790919400.407337:0:9041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919400.407348:0:9041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919400.407351:0:9041:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790919400.407357:0:9041:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3a6ada000 00000020:00000080:3.0:1790919400.407359:0:9041:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919400.407375:0:9041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919400.407377:0:9041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919400.407378:0:9041:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790919400.407381:0:9041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790919400.407504:0:9028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790919400.407533:0:9028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919400.407547:0:9028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.407558:0:9028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919400.407603:0:9028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790919400.407606:0:9028:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3a6ada000 10000000:01000000:0.0:1790919400.407609:0:9028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3a6ada000 10000000:01000000:0.0:1790919400.407612:0:9028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919400.407616:0:9028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3a6ada000 from 1 10000000:01000000:0.0:1790919400.407619:0:9028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919400.407649:0:9028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.407656:0:9028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.407665:0:9028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.407680:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124928:0@lo:101: 00000100:00100000:0.0:1790919400.407728:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.407778:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919400.407912:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978124928 00000100:00100000:3.0:1790919400.407918:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978124928 00000100:00100000:3.0:1790919400.407958:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790919400.407967:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9028:x1877914978124928:12345-0@lo:101: 00010000:00010000:3.0:1790919400.407980:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919400.407993:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159134ca expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.408013:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159134ca expref: 17 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.408023:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159134ca expref: 17 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919400.408031:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c000, rc 0) 00000100:00100000:3.0:1790919400.408113:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978124928:12345-0@lo:101: Request processed in 146us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.408119:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919400.408288:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978124928:0@lo:101: 00010000:00010000:0.0:1790919400.408302:0:9028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.408311:0:9028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.408392:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125056:0@lo:501: 00000100:00100000:0.0:1790919400.408431:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.408459:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919400.408504:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125056 00000100:00100000:1.0:1790919400.408509:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125056 00000100:00100000:1.0:1790919400.408540:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790919400.408547:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9028:x1877914978125056:12345-0@lo:501: 00000100:00100000:1.0:1790919400.408791:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9028:x1877914978125056:12345-0@lo:501: Request processed in 244us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.408799:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790919400.408969:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125056:0@lo:501: 00000100:00100000:0.0:1790919400.408996:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125184:0@lo:503: 00000100:00100000:0.0:1790919400.409037:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.409088:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919400.409216:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125184 00000100:00100000:3.0:1790919400.409220:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125184 00000100:00100000:3.0:1790919400.409248:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790919400.409255:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978125184:12345-0@lo:503: 00000100:00100000:3.0:1790919400.409458:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978125184:12345-0@lo:503: Request processed in 202us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.409465:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790919400.411692:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125184:0@lo:503: 00000040:00080000:0.0:1790919400.412408:0:9028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919400.412491:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125312:0@lo:502: 00000100:00100000:0.0:1790919400.412560:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.412596:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919400.412650:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125312 00000100:00100000:3.0:1790919400.412657:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125312 00000100:00100000:3.0:1790919400.412701:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790919400.412710:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978125312:12345-0@lo:502: 00000100:00100000:3.0:1790919400.412940:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978125312:12345-0@lo:502: Request processed in 230us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.412948:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790919400.413212:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125312:0@lo:502: 00000040:00080000:0.0:1790919400.413488:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790919400.413539:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790919400.413573:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790919400.413629:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790919400.413668:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790919400.413712:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790919400.413750:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790919400.413777:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790919400.413923:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790919400.413960:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790919400.413987:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790919400.414026:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790919400.414203:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790919400.414248:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790919400.414316:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790919400.414353:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790919400.414387:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790919400.414460:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790919400.414503:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790919400.414539:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790919400.414609:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790919400.414650:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790919400.414683:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790919400.414733:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790919400.414770:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790919400.414802:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790919400.415021:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790919400.415423:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1790919400.415469:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790919400.415521:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1790919400.415578:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1790919400.415614:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1790919400.415648:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1790919400.415699:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1790919400.415736:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1790919400.415798:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1790919400.415914:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1790919400.415951:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1790919400.415998:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1790919400.416040:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1790919400.416259:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1790919400.416288:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1790919400.416327:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1790919400.416355:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1790919400.416380:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1790919400.416429:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1790919400.416474:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125440:0@lo:502: 00000100:00100000:0.0:1790919400.416543:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.416620:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.416665:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125440 00000100:00100000:2.0:1790919400.416673:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125440 00000100:00100000:2.0:1790919400.416742:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790919400.416750:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978125440:12345-0@lo:502: 00000100:00100000:2.0:1790919400.416968:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978125440:12345-0@lo:502: Request processed in 218us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.416976:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790919400.417091:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978125440:0@lo:502: 00000040:00080000:0.0:1790919400.417173:0:9028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1790919400.417183:0:9028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1790919400.418344:0:9042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790919400.418361:0:9042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95f3bbfdb380) 00000020:00000080:1.0:1790919400.418382:0:9042:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1790919400.418482:0:9042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3a6ada000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790919400.418487:0:9042:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3a6ada000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790919400.418489:0:9042:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3a6ada000 3 00010000:00080000:1.0:1790919400.418518:0:9042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f2862e9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919400.420666:0:9042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1790919400.420904:0:9042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790919400.420939:0:9042:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919400.420948:0:9042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x951c50ad159134df 00000100:00080000:1.0:1790919400.420955:0:9042:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919400.420965:0:9042:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f2862e9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919400.420996:0:9042:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e24380 x1877914978125568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919400.421024:0:9042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790919400.421348:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978125568:0@lo:38: 00000100:00100000:2.0:1790919400.421423:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.421480:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125568 00000100:00100000:2.0:1790919400.421487:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125568 00000100:00100000:2.0:1790919400.421514:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790919400.421526:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3457:x1877914978125568:12345-0@lo:38: 00010000:00080000:2.0:1790919400.421559:0:7785:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1790919400.421588:0:7785:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x951c50ad159134e6 00000004:00100000:2.0:1790919400.421603:0:7785:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790919400.421631:0:7785:0:(import.c:65:import_set_state_nolock()) ffff95f3b6103000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919400.421680:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1877914978125568:12345-0@lo:38: Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.421688:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790919400.421725:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24380 x1877914978125568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.421735:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919400.421743:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790919400.421749:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790919400.421752:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790919400.421754:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790919400.421760:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978125568:0@lo:38: 00000100:00100000:2.0:1790919400.422022:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978125696:0@lo:400: 00000100:00100000:2.0:1790919400.422072:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422099:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978126208:0@lo:400: 00000100:00100000:0.0:1790919400.422228:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125696 00000100:00100000:0.0:1790919400.422233:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125696 00000100:00100000:0.0:1790919400.422267:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919400.422275:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978125696:12345-0@lo:400: 00000100:00100000:0.0:1790919400.422314:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978125696:12345-0@lo:400: Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.422320:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919400.422370:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790919400.422407:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3bc237800 x1877914978125696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.422429:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978125696:0@lo:400: 00000100:00100000:2.0:1790919400.422442:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790919400.422448:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978125824:0@lo:400: 00000100:00100000:2.0:1790919400.422483:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422503:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978126336:0@lo:400: 00000100:00100000:2.0:1790919400.422523:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422549:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978125952:0@lo:400: 00000100:00100000:2.0:1790919400.422572:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422592:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978126464:0@lo:400: 00000100:00100000:2.0:1790919400.422613:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422631:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790919400.422636:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978126080:0@lo:400: 00000100:00100000:2.0:1790919400.422656:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422673:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978126592:0@lo:400: 00000100:00100000:2.0:1790919400.422691:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.422720:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126208 00000100:00100000:2.0:1790919400.422724:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126208 00000100:00100000:2.0:1790919400.422749:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126336 00000100:00100000:2.0:1790919400.422752:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126336 00000100:00100000:2.0:1790919400.422763:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126080 00000100:00100000:2.0:1790919400.422765:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126080 00000100:00100000:2.0:1790919400.422778:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919400.422784:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978126208:12345-0@lo:400: 00000100:00100000:0.0:1790919400.422916:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919400.422924:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978126336:12345-0@lo:400: 00000020:01000004:1.0:1790919400.423115:0:9042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790919400.423142:0:9042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff95f3bbfdcd40) 00000020:00000080:1.0:1790919400.423163:0:9042:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1790919400.423230:0:9042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3a6ada000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790919400.423234:0:9042:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3a6ada000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790919400.423236:0:9042:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3a6ada000 3 00010000:00080000:1.0:1790919400.423262:0:9042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f2862ea000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919400.424896:0:9042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1790919400.425038:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978126208:12345-0@lo:400: Request processed in 2251us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.425049:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919400.425100:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919400.425110:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978126080:12345-0@lo:400: 00000100:00100000:2.0:1790919400.425169:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978126080:12345-0@lo:400: Request processed in 62us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.425181:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919400.425210:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125824 00000100:00100000:2.0:1790919400.425217:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125824 00000100:00100000:2.0:1790919400.425247:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978125952 00000100:00100000:2.0:1790919400.425250:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978125952 00000100:00100000:2.0:1790919400.425262:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919400.425267:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978125824:12345-0@lo:400: 00000100:00100000:0.0:1790919400.429600:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978126336:12345-0@lo:400: Request processed in 6670us (7067us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919400.429615:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919400.429864:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978125824:12345-0@lo:400: Request processed in 4537us (7321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.429875:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919400.429913:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919400.429926:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978125952:12345-0@lo:400: 00000100:00100000:2.0:1790919400.430002:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978125952:12345-0@lo:400: Request processed in 81us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.430007:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919400.430029:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126464 00000100:00100000:2.0:1790919400.430037:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126464 00000100:00100000:2.0:1790919400.430093:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126592 00000100:00100000:2.0:1790919400.430098:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126592 00000100:00100000:2.0:1790919400.430117:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919400.430124:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978126464:12345-0@lo:400: 00000100:00100000:2.0:1790919400.430159:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978126464:12345-0@lo:400: Request processed in 35us (7545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.430165:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919400.430177:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919400.430183:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978126592:12345-0@lo:400: 00000100:00100000:2.0:1790919400.430210:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978126592:12345-0@lo:400: Request processed in 27us (7517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.430225:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790919400.430245:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919400.430249:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919400.430252:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790919400.430292:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da9c00 x1877914978126080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.430306:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978126080:0@lo:400: 00010000:00080000:2.0:1790919400.430316:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da8380 x1877914978126592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.430324:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978126592:0@lo:400: 00000100:00100000:2.0:1790919400.430333:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978125952:0@lo:400: 00010000:00080000:2.0:1790919400.430342:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da9880 x1877914978126464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.430349:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978126464:0@lo:400: 00000100:00100000:2.0:1790919400.430386:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978125824:0@lo:400: 00010000:00080000:2.0:1790919400.430399:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398daa680 x1877914978126336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.430407:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978126336:0@lo:400: 00010000:00080000:2.0:1790919400.430430:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f398da9180 x1877914978126208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919400.430438:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978126208:0@lo:400: 00000100:00100000:1.0:1790919400.431070:0:9043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9043:1877914978126720:0@lo:901: 00000100:00100000:1.0:1790919400.431127:0:9043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919400.431161:0:6456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126720 00000100:00100000:1.0:1790919400.431165:0:6456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126720 00000100:00100000:1.0:1790919400.431202:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919400.431209:0:6456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9043:x1877914978126720:12345-0@lo:901: 00000100:00100000:1.0:1790919400.431581:0:6456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9043:x1877914978126720:12345-0@lo:901: Request processed in 371us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.431587:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790919400.431606:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919400.431619:0:9043:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00e40 going to sleep for 11 seconds 00010000:00080000:1.0:1790919400.431636:0:9043:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f382e24380 x1877914978126720/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790919416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919400.431647:0:9043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9043:1877914978126720:0@lo:901: 00000020:00000080:1.0:1790919400.433089:0:9042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1790919400.433126:0:9042:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919400.433136:0:9042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x951c50ad159134f4 00000100:00080000:1.0:1790919400.433144:0:9042:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919400.433152:0:9042:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff95f2862ea000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919400.433180:0:9042:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f38d548e00 x1877914978126848/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919400.433213:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978126848:0@lo:38: 00000100:00100000:1.0:1790919400.433260:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919400.433309:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126848 00000100:00100000:1.0:1790919400.433315:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126848 00000100:00100000:1.0:1790919400.433340:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919400.433346:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978126848:12345-0@lo:38: 00010000:00080000:1.0:1790919400.433373:0:6447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1790919400.433399:0:6447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x951c50ad159134fb 00000004:00100000:1.0:1790919400.433423:0:6447:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790919400.433450:0:6447:0:(import.c:65:import_set_state_nolock()) ffff95f2862ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919400.433493:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3457:x1877914978126848:12345-0@lo:38: Request processed in 145us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919400.433499:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790919400.433528:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d548e00 x1877914978126848/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919400.433537:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919400.433548:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790919400.433555:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790919400.433559:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790919400.433560:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2862ea000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790919400.433565:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978126848:0@lo:38: 00000100:00080000:1.0:1790919400.433583:0:9042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1790919400.434917:0:9042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1790919400.435019:0:9028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1790919400.435047:0:9028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790919400.435091:0:9028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.435102:0:9028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790919400.435162:0:9028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790919400.435163:0:9028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790919400.435165:0:9028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919400.435166:0:9028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919400.435167:0:9028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919400.435169:0:9028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919400.435171:0:9028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790919400.435172:0:9028:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790919400.435174:0:9028:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790919400.435175:0:9028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919400.435177:0:9028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790919400.435180:0:9028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790919400.435182:0:9028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790919400.435184:0:9028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790919400.435185:0:9028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919400.435186:0:9028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919400.435187:0:9028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919400.435188:0:9028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919400.435189:0:9028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790919400.435190:0:9028:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790919400.435191:0:9028:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790919400.435192:0:9028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919400.435193:0:9028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790919400.435214:0:9028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790919400.435231:0:9028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978126976:0@lo:253: 00000100:00100000:0.0:1790919400.435285:0:9028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.435314:0:9028:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.436447:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978126976 00000100:00100000:2.0:1790919400.436458:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978126976 00000100:00100000:2.0:1790919400.436510:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790919400.436518:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9028:x1877914978126976:12345-0@lo:253: 20000000:01000000:2.0:1790919400.436546:0:6438:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790919400.436561:0:6438:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790919400.455449:0:6438:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790919400.455469:0:6438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790919400.455519:0:6461:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790919400.455524:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790919400.455546:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.455571:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159133d5 expref: 17 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.455578:0:6461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913429 expref: 17 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.455585:0:6461:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.455624:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913429 expref: 17 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.455638:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913429 expref: 17 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.455652:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398dabb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978127104:0@lo:104: 00000100:00100000:0.0:1790919400.455715:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919400.455768:0:6461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159133d5 expref: 17 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919400.455777:0:6461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159133d5 expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919400.455785:0:6461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398daa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978127232:0@lo:104: 00000100:00100000:0.0:1790919400.455807:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919400.455835:0:6461:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919400.457491:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127104 00000100:00100000:2.0:1790919400.457503:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127104 00000100:00100000:2.0:1790919400.457540:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127232 00000100:00100000:2.0:1790919400.457544:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127232 00000100:00100000:2.0:1790919400.457559:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919400.457567:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6461:x1877914978127104:12345-0@lo:104: 00010000:00010000:2.0:1790919400.457583:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.457673:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919400.457679:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:6461:x1877914978127104:12345-0@lo:104: Request processed in 113us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.457687:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919400.457707:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919400.457713:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978127232:12345-0@lo:104: 00010000:00010000:2.0:1790919400.457722:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.457755:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790919400.457759:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:6461:x1877914978127232:12345-0@lo:104: Request processed in 47us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.457765:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919400.457870:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398dabb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978127104:0@lo:104: 00000100:00100000:0.0:1790919400.457880:0:6461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398daa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6461:1877914978127232:0@lo:104: 00010000:00010000:0.0:1790919400.457916:0:6461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461402:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919400.461438:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461450:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919400.461454:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461467:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919400.461474:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919400.461480:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919400.461532:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461538:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919400.461559:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461565:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15913429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913430 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461581:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919400.461584:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461589:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204a200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919400.461592:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461609:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919400.461616:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919400.461621:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919400.461635:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461641:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919400.461646:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461653:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad159133d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159133dc expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461670:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.461671:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919400.461673:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919400.461691:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978127360:0@lo:103: 00000100:00100000:2.0:1790919400.461760:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.461802:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919400.461808:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978127488:0@lo:103: 00000100:00100000:2.0:1790919400.461839:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919400.461865:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127360 00000100:00100000:2.0:1790919400.461873:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127360 00010000:00010000:2.0:1790919400.461899:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913429 expref: 18 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.461933:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127488 00000100:00100000:2.0:1790919400.461936:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127488 00010000:00010000:2.0:1790919400.461947:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159133d5 expref: 19 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919400.461963:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919400.461971:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3458:x1877914978127360:12345-0@lo:103: 00010000:00010000:2.0:1790919400.461983:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919400.461988:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913429 expref: 19 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.461997:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913429 expref: 19 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462010:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381696200/0x951c50ad15913430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913429 expref: 19 pid: 6439 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462022:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919400.462072:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:3458:x1877914978127360:12345-0@lo:103: Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.462079:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919400.462096:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919400.462101:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:3458:x1877914978127488:12345-0@lo:103: 00010000:00010000:2.0:1790919400.462107:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919400.462111:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159133d5 expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462118:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159133d5 expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462132:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166cc00/0x951c50ad159133dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159133d5 expref: 17 pid: 6438 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462141:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462148:0:6432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790919400.462161:0:6432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006637919s 00010000:00010000:2.0:1790919400.462165:0:6432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462171:0:6432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462177:0:6432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462183:0:6432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462188:0:6432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919400.462192:0:6432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462200:0:6432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462216:0:6432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462236:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919400.462261:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3458:x1877914978127488:12345-0@lo:103: Request processed in 160us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919400.462270:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919400.462302:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978127488:0@lo:103: 00000100:00100000:2.0:1790919400.462310:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978127360:0@lo:103: 00010000:00010000:2.0:1790919400.462333:0:6461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462340:0:6461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462347:0:6461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014000/0x951c50ad15913502 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919400.462371:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919400.463639:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:9028:x1877914978126976:12345-0@lo:253: Request processed in 27115us (28348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919400.463651:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790919400.463735:0:9028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9028:1877914978126976:0@lo:253: 10000000:01000000:0.0:1790919400.463749:0:9028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790919400.463753:0:9028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919400.463754:0:9028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790919400.463756:0:9028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919400.463757:0:9028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919400.463758:0:9028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919400.463759:0:9028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919400.463761:0:9028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790919400.463763:0:9028:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790919400.463764:0:9028:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790919400.463765:0:9028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919400.463767:0:9028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790919400.463784:0:9028:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790919400.472323:0:9028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919400.472530:0:9028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919400.472757:0:9028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919400.472995:0:9028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919400.473314:0:9028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919400.473563:0:9028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790919400.474873:0:9028:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790919400.671167:0:9028:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790919400.671175:0:9028:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790919400.671210:0:9028:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790919400.671271:0:9028:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790919400.671288:0:9028:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790919400.671314:0:9028:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790919400.861291:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919401.372216:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919401.372242:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978127616:0@lo:41: 00000100:00100000:1.0:1790919401.372307:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919401.372419:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127616 00000100:00100000:3.0:1790919401.372429:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127616 00000100:00100000:3.0:1790919401.372482:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919401.372491:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978127616:12345-0@lo:41: 00000004:00000024:3.0:1790919401.372529:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919401.372572:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978127616:12345-0@lo:41: Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919401.372579:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919401.372580:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919401.372589:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978127744:0@lo:41: 00000100:00100000:2.0:1790919401.372616:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919401.372650:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127744 00000100:00100000:1.0:1790919401.372654:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127744 00000100:00100000:1.0:1790919401.372687:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919401.372694:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978127744:12345-0@lo:41: 00000004:00000024:1.0:1790919401.372713:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919401.372754:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978127744:12345-0@lo:41: Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919401.372769:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919401.372808:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978127744:0@lo:41: 00000100:00100000:1.0:1790919401.372842:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978127616:0@lo:41: 00000100:00100000:2.0:1790919401.888601:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978127872:0@lo:13: 00000100:00100000:2.0:1790919401.888675:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919401.889269:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978128000:0@lo:13: 00000100:00100000:3.0:1790919401.889302:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919401.889559:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978127872 00000100:00100000:2.0:1790919401.889568:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978127872 00000100:00100000:2.0:1790919401.889609:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128000 00000100:00100000:2.0:1790919401.889613:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128000 00000100:00100000:2.0:1790919401.889627:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919401.889635:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978127872:12345-0@lo:13: 00002000:00000024:2.0:1790919401.889682:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1790919401.889879:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919401.889893:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919401.889902:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978128000:12345-0@lo:13: 00002000:00000024:3.0:1790919401.889913:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919401.889952:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978128000:12345-0@lo:13: Request processed in 52us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919401.889960:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790919401.889998:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24380 x1877914978128000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919401.890016:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978128000:0@lo:13: 00000100:00100000:2.0:1790919401.890570:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978127872:12345-0@lo:13: Request processed in 933us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919401.890578:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790919401.890879:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f398da9500 x1877914978127872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919401.890895:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978127872:0@lo:13: 00010000:00010000:2.0:1790919402.908194:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919403.944488:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919404.956326:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919405.468240:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978128384:0@lo:400: 00000100:00100000:1.0:1790919405.468306:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919405.468354:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978128896:0@lo:400: 00000100:00100000:1.0:1790919405.468388:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919405.468408:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978129408:0@lo:400: 00000100:00100000:1.0:1790919405.468430:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919405.468452:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790919405.468458:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978128512:0@lo:400: 00000100:00100000:1.0:1790919405.468480:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919405.468497:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978129024:0@lo:400: 00000100:00100000:1.0:1790919405.468518:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919405.468552:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128384 00000100:00100000:1.0:1790919405.468558:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128384 00000100:00100000:1.0:1790919405.468597:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128512 00000100:00100000:1.0:1790919405.468600:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128512 00000100:00100000:1.0:1790919405.468616:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919405.468624:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978128384:12345-0@lo:400: 00000100:00100000:1.0:1790919405.468675:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978128384:12345-0@lo:400: Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919405.468682:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919405.468698:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790919405.468712:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978128512:12345-0@lo:400: 00000100:00100000:1.0:1790919405.468744:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978128512:12345-0@lo:400: Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919405.468749:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790919405.468768:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128896 00000100:00100000:1.0:1790919405.468772:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128896 00000100:00100000:0.0:1790919405.469932:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978128256:0@lo:400: 00000100:00100000:0.0:1790919405.469984:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919405.470012:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978128768:0@lo:400: 00000100:00100000:0.0:1790919405.470034:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919405.470069:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978129280:0@lo:400: 00000100:00100000:0.0:1790919405.470098:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919405.470116:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790919405.470123:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978128128:0@lo:400: 00000100:00100000:0.0:1790919405.470149:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919405.470175:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978128640:0@lo:400: 00000100:00100000:0.0:1790919405.470197:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919405.470208:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978129152:0@lo:400: 00000100:00100000:0.0:1790919405.470230:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919405.470279:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129408 00000100:00100000:0.0:1790919405.470285:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129408 00000100:00100000:0.0:1790919405.470311:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128256 00000100:00100000:0.0:1790919405.470314:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128256 00000100:00100000:0.0:1790919405.470324:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128768 00000100:00100000:0.0:1790919405.470326:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128768 00000100:00100000:0.0:1790919405.470337:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129280 00000100:00100000:0.0:1790919405.470340:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129280 00000100:00100000:0.0:1790919405.470351:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128640 00000100:00100000:0.0:1790919405.470354:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128640 00000100:00100000:0.0:1790919405.470366:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919405.470372:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978129408:12345-0@lo:400: 00000100:00100000:0.0:1790919405.470426:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978129408:12345-0@lo:400: Request processed in 53us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919405.470433:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919405.470448:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919405.470462:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978128256:12345-0@lo:400: 00000100:00100000:0.0:1790919405.470497:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978128256:12345-0@lo:400: Request processed in 35us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919405.470502:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919405.470515:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919405.470521:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978128768:12345-0@lo:400: 00000100:00100000:0.0:1790919405.470547:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978128768:12345-0@lo:400: Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919405.470553:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919405.470564:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790919405.470570:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978129280:12345-0@lo:400: 00000100:00100000:0.0:1790919405.470597:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978129280:12345-0@lo:400: Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919405.470602:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790919405.470612:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919405.470618:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978128640:12345-0@lo:400: 00000100:00100000:0.0:1790919405.470656:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978128640:12345-0@lo:400: Request processed in 39us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919405.470661:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919405.470678:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129024 00000100:00100000:0.0:1790919405.470681:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129024 00000100:00100000:0.0:1790919405.470705:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129152 00000100:00100000:0.0:1790919405.470708:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129152 00000100:00100000:0.0:1790919405.470727:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919405.470733:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978129024:12345-0@lo:400: 00000100:00100000:0.0:1790919405.470765:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978129024:12345-0@lo:400: Request processed in 33us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919405.470778:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919405.470790:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919405.470905:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919405.470913:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978128896:12345-0@lo:400: 00000100:00100000:1.0:1790919405.470947:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978128896:12345-0@lo:400: Request processed in 36us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919405.470952:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919405.471074:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978128128 00000100:00100000:2.0:1790919405.471079:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978128128 00000100:00100000:2.0:1790919405.471106:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790919405.471112:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3461:x1877914978128128:12345-0@lo:400: 00000100:00100000:2.0:1790919405.471146:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3461:x1877914978128128:12345-0@lo:400: Request processed in 34us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919405.471152:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790919405.471686:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978129152:12345-0@lo:400: 00000100:00100000:0.0:1790919405.471721:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978129152:12345-0@lo:400: Request processed in 38us (1490us total) trans 0 rc 0/0 00000100:00080000:1.0:1790919405.476028:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919405.476038:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919405.476041:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919405.476111:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978128512:0@lo:400: 00010000:00080000:1.0:1790919405.476131:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aedab480 x1877914978129024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919405.476141:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978129024:0@lo:400: 00000100:00100000:1.0:1790919405.476154:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978128384:0@lo:400: 00010000:00080000:1.0:1790919405.476164:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aedab800 x1877914978128896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919405.476172:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978128896:0@lo:400: 00010000:00080000:1.0:1790919405.476183:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aedaa300 x1877914978129408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919405.476191:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978129408:0@lo:400: 00000100:00100000:0.0:1790919405.476898:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919405.477647:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978128128:0@lo:400: 00010000:00080000:0.0:1790919405.479113:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aeda9f80 x1877914978128640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919405.479130:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978128640:0@lo:400: 00010000:00080000:0.0:1790919405.479143:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aedaad80 x1877914978129152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919405.479151:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978129152:0@lo:400: 00010000:00080000:0.0:1790919405.479162:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aeda8380 x1877914978128256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919405.479169:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978128256:0@lo:400: 00010000:00080000:0.0:1790919405.479180:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aeda8e00 x1877914978128768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919405.479187:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978128768:0@lo:400: 00010000:00080000:0.0:1790919405.479197:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aeda9180 x1877914978129280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919405.479204:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978129280:0@lo:400: 00010000:00010000:2.0:1790919405.984438:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919406.090208:0:9387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1790919406.492686:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978129536:0@lo:41: 00000100:00100000:1.0:1790919406.492752:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919406.492818:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129536 00000100:00100000:1.0:1790919406.492826:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129536 00000100:00100000:1.0:1790919406.492865:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919406.492874:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978129536:12345-0@lo:41: 00000004:00000024:1.0:1790919406.492910:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919406.492952:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978129536:12345-0@lo:41: Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919406.492959:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919406.493001:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978129536:0@lo:41: 00000100:00100000:0.0:1790919406.493383:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978129664:0@lo:41: 00000100:00100000:0.0:1790919406.493428:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919406.493674:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129664 00000100:00100000:2.0:1790919406.493679:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129664 00000100:00100000:2.0:1790919406.493713:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919406.493720:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978129664:12345-0@lo:41: 00000004:00000024:2.0:1790919406.493742:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790919406.493787:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978129664:12345-0@lo:41: Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919406.493793:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790919406.493910:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978129664:0@lo:41: 00010000:00010000:3.0:1790919407.004251:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919407.005581:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978129792:0@lo:13: 00000100:00100000:3.0:1790919407.005648:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919407.005704:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129792 00000100:00100000:3.0:1790919407.005712:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129792 00000100:00100000:3.0:1790919407.005775:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919407.005786:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978129792:12345-0@lo:13: 00002000:00000024:3.0:1790919407.005819:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919407.005862:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978129792:12345-0@lo:13: Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919407.005869:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790919407.005905:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919407.005936:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30a80 x1877914978129792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919407.005955:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978129792:0@lo:13: 00000100:00100000:1.0:1790919407.008551:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919407.008574:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978129920:0@lo:13: 00000100:00100000:1.0:1790919407.008637:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919407.009115:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978129920 00000100:00100000:3.0:1790919407.009123:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978129920 00000100:00100000:3.0:1790919407.009186:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919407.009196:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978129920:12345-0@lo:13: 00002000:00000024:3.0:1790919407.009218:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919407.009268:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978129920:12345-0@lo:13: Request processed in 73us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919407.009276:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790919407.009332:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aedaa300 x1877914978129920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919407.009352:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978129920:0@lo:13: 00000100:00080000:1.0:1790919407.009533:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1790919408.028284:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790919408.028293:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3be491000 from 39 10000000:01000000:0.0:1790919408.028299:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919408.028349:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.028371:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.028382:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919408.028406:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130048:0@lo:101: 00000100:00100000:0.0:1790919408.028478:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.028526:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.028725:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130048 00000100:00100000:3.0:1790919408.028733:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130048 00000100:00100000:3.0:1790919408.028781:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790919408.028790:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978130048:12345-0@lo:101: 00010000:00010000:3.0:1790919408.028804:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919408.028818:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913509 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.028843:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913509 expref: 16 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.028853:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913509 expref: 16 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.028877:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2dc00, rc 0) 00000100:00100000:3.0:1790919408.028935:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978130048:12345-0@lo:101: Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.028942:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790919408.029103:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130048:0@lo:101: 00010000:00010000:0.0:1790919408.029117:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.029126:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919408.029176:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130176:0@lo:501: 00000100:00100000:0.0:1790919408.029202:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.029246:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.029432:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130176 00000100:00100000:2.0:1790919408.029437:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130176 00000100:00100000:2.0:1790919408.029471:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790919408.029479:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978130176:12345-0@lo:501: 00000100:00100000:2.0:1790919408.029746:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978130176:12345-0@lo:501: Request processed in 268us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.029760:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790919408.029889:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130176:0@lo:501: 00000100:00100000:1.0:1790919408.029927:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130304:0@lo:503: 00000100:00100000:1.0:1790919408.029965:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.029987:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.030480:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130304 00000100:00100000:2.0:1790919408.030487:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130304 00000100:00100000:2.0:1790919408.030513:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790919408.030521:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978130304:12345-0@lo:503: 00000100:00100000:2.0:1790919408.030734:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978130304:12345-0@lo:503: Request processed in 213us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.030742:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790919408.030828:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130304:0@lo:503: 00010000:00010000:0.0:1790919408.031025:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919408.031511:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9491:1877914978130432:0@lo:502: 00000100:00100000:0.0:1790919408.031564:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.031599:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.031652:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130432 00000100:00100000:2.0:1790919408.031657:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130432 00000100:00100000:2.0:1790919408.031690:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790919408.031697:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9491:x1877914978130432:12345-0@lo:502: 00000100:00100000:2.0:1790919408.031995:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9491:x1877914978130432:12345-0@lo:502: Request processed in 298us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.032002:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790919408.032084:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9491:1877914978130432:0@lo:502: 00000100:00100000:0.0:1790919408.032125:0:9491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9491:1877914978130560:0@lo:502: 00000100:00100000:0.0:1790919408.032167:0:9491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.032195:0:9491:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.032527:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130560 00000100:00100000:1.0:1790919408.032533:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130560 00000100:00100000:1.0:1790919408.032567:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790919408.032574:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9491:x1877914978130560:12345-0@lo:502: 00000100:00100000:1.0:1790919408.032731:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9491:x1877914978130560:12345-0@lo:502: Request processed in 157us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.032745:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790919408.033850:0:9491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9491:1877914978130560:0@lo:502: 00000040:00080000:0.0:1790919408.033887:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1790919408.034138:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1790919408.034156:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919408.034166:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.034178:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919408.034188:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790919408.034190:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1790919408.034193:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919408.034235:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.034243:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.034254:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.034272:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130688:0@lo:101: 00000100:00100000:1.0:1790919408.034319:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.034352:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.034475:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130688 00000100:00100000:0.0:1790919408.034482:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130688 00000100:00100000:0.0:1790919408.034524:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790919408.034533:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978130688:12345-0@lo:101: 00010000:00010000:0.0:1790919408.034545:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919408.034557:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913517 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.034580:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913517 expref: 17 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.034590:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913517 expref: 17 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.034597:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015000, rc 0) 00000100:00100000:0.0:1790919408.034641:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978130688:12345-0@lo:101: Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.034647:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790919408.034887:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130688:0@lo:101: 00010000:00010000:1.0:1790919408.034911:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.034921:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.034972:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130816:0@lo:501: 00000100:00100000:1.0:1790919408.034998:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.035022:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.035132:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130816 00000100:00100000:2.0:1790919408.035137:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130816 00000100:00100000:2.0:1790919408.035163:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790919408.035170:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978130816:12345-0@lo:501: 00000100:00100000:2.0:1790919408.035430:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978130816:12345-0@lo:501: Request processed in 260us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.035437:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790919408.035599:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130816:0@lo:501: 00000100:00100000:1.0:1790919408.035638:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130944:0@lo:503: 00000100:00100000:1.0:1790919408.035679:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.035708:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.035802:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978130944 00000100:00100000:2.0:1790919408.035807:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978130944 00000100:00100000:2.0:1790919408.035839:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790919408.035845:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978130944:12345-0@lo:503: 00000100:00100000:2.0:1790919408.036201:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978130944:12345-0@lo:503: Request processed in 355us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.036208:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790919408.036328:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978130944:0@lo:503: 00000100:00100000:1.0:1790919408.036879:0:9492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9492:1877914978131072:0@lo:502: 00000100:00100000:1.0:1790919408.036985:0:9492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.037015:0:9492:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.037079:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131072 00000100:00100000:0.0:1790919408.037084:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131072 00000100:00100000:0.0:1790919408.037117:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790919408.037124:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9492:x1877914978131072:12345-0@lo:502: 00000100:00100000:0.0:1790919408.037315:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9492:x1877914978131072:12345-0@lo:502: Request processed in 190us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.037321:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790919408.037603:0:9492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9492:1877914978131072:0@lo:502: 00000020:01000000:1.0:1790919408.037637:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919408.037645:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919408.037648:0:9492:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790919408.037652:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790919408.037654:0:9492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790919408.037669:0:9492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9492:1877914978131200:0@lo:502: 00000100:00100000:1.0:1790919408.037703:0:9492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.037728:0:9492:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.037828:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131200 00000100:00100000:2.0:1790919408.037833:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131200 00000100:00100000:2.0:1790919408.037865:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790919408.037871:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9492:x1877914978131200:12345-0@lo:502: 00000100:00100000:2.0:1790919408.038113:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9492:x1877914978131200:12345-0@lo:502: Request processed in 240us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.038119:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790919408.039022:0:9492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9492:1877914978131200:0@lo:502: 00000020:01000000:1.0:1790919408.039083:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919408.039091:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919408.039093:0:9492:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790919408.039105:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1790919408.039324:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1790919408.039343:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790919408.039352:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.039373:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919408.039383:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790919408.039386:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3b4712800 from 39 10000000:01000000:0.0:1790919408.039388:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919408.039417:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.039425:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.039433:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919408.039448:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131328:0@lo:101: 00000100:00100000:0.0:1790919408.039492:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.039521:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.039665:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131328 00000100:00100000:2.0:1790919408.039671:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131328 00000100:00100000:3.0:1790919408.039810:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790919408.039821:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978131328:12345-0@lo:101: 00010000:00010000:3.0:1790919408.039832:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919408.039844:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913525 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.039866:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913525 expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.039876:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913525 expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.039883:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2d600, rc 0) 00000100:00100000:3.0:1790919408.039927:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978131328:12345-0@lo:101: Request processed in 108us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.039933:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790919408.039992:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131328:0@lo:101: 00010000:00010000:0.0:1790919408.040004:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.040013:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919408.040093:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131456:0@lo:501: 00000100:00100000:0.0:1790919408.040119:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.040140:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.040194:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131456 00000100:00100000:1.0:1790919408.040199:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131456 00000100:00100000:1.0:1790919408.040239:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790919408.040246:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978131456:12345-0@lo:501: 00000100:00100000:1.0:1790919408.040510:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978131456:12345-0@lo:501: Request processed in 264us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.040517:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790919408.045647:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131456:0@lo:501: 00000100:00100000:0.0:1790919408.045784:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131584:0@lo:503: 00000100:00100000:0.0:1790919408.045873:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.045919:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.046246:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131584 00000100:00100000:2.0:1790919408.046253:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131584 00000100:00100000:2.0:1790919408.046300:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790919408.046308:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978131584:12345-0@lo:503: 00000100:00100000:2.0:1790919408.046513:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978131584:12345-0@lo:503: Request processed in 205us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.046522:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790919408.046545:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131584:0@lo:503: 00000100:00100000:0.0:1790919408.047168:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9493:1877914978131712:0@lo:502: 00000100:00100000:0.0:1790919408.047212:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.047253:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.047306:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131712 00000100:00100000:3.0:1790919408.047311:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131712 00000100:00100000:3.0:1790919408.047344:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790919408.047351:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9493:x1877914978131712:12345-0@lo:502: 00000100:00100000:3.0:1790919408.047553:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9493:x1877914978131712:12345-0@lo:502: Request processed in 202us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.047559:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790919408.047684:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9493:1877914978131712:0@lo:502: 00000100:00100000:0.0:1790919408.047724:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9493:1877914978131840:0@lo:502: 00000100:00100000:0.0:1790919408.047757:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.047779:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.047798:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131840 00000100:00100000:2.0:1790919408.047802:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131840 00000100:00100000:2.0:1790919408.047834:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790919408.047841:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9493:x1877914978131840:12345-0@lo:502: 00000100:00100000:2.0:1790919408.047979:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9493:x1877914978131840:12345-0@lo:502: Request processed in 138us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.047986:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790919408.048119:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9493:1877914978131840:0@lo:502: 00000040:00080000:0.0:1790919408.048137:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1790919408.052167:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1790919408.052203:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919408.052302:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.052316:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919408.052326:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790919408.052328:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4712800 from 6 10000000:01000000:1.0:1790919408.052331:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790919408.052380:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.052388:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.052398:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.052419:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131968:0@lo:101: 00000100:00100000:1.0:1790919408.052480:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.052583:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.061431:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978131968 00000100:00100000:0.0:1790919408.061463:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978131968 00000100:00100000:0.0:1790919408.061521:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790919408.061531:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978131968:12345-0@lo:101: 00010000:00010000:0.0:1790919408.061549:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919408.061569:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015200/0x951c50ad1591353a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913533 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.061594:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015200/0x951c50ad1591353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913533 expref: 19 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.061606:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015200/0x951c50ad1591353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913533 expref: 19 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.061614:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015200, rc 0) 00000100:00100000:0.0:1790919408.061728:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978131968:12345-0@lo:101: Request processed in 199us (9248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.061735:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790919408.069311:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978131968:0@lo:101: 00010000:00010000:1.0:1790919408.069341:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.069353:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919408.071861:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132096:0@lo:256: 00000100:00100000:2.0:1790919408.071941:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.072042:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.080207:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132096 00000100:00100000:3.0:1790919408.080223:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132096 00000100:00100000:3.0:1790919408.080286:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790919408.080296:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978132096:12345-0@lo:256: 20000000:01000000:3.0:1790919408.080322:0:6439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790919408.080345:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790919408.080348:0:6439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790919408.080503:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978132096:12345-0@lo:256: Request processed in 209us (8562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.080511:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790919408.083439:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132096:0@lo:256: 10000000:01000000:1.0:1790919408.083510:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919408.083522:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.083533:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919408.083542:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790919408.083546:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1790919408.083549:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790919408.083585:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.083594:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.083604:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.083624:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132224:0@lo:101: 00000100:00100000:1.0:1790919408.083693:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.083740:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.084173:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132224 00000100:00100000:0.0:1790919408.084182:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132224 00000100:00100000:0.0:1790919408.084233:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790919408.084242:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978132224:12345-0@lo:101: 00010000:00010000:0.0:1790919408.084256:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919408.084268:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913541 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.084291:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913541 expref: 20 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.084300:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913541 expref: 20 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.084320:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919408.084374:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978132224:12345-0@lo:101: Request processed in 133us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.084381:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790919408.085045:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132224:0@lo:101: 00010000:00010000:1.0:1790919408.085099:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.085109:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.085172:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132352:0@lo:501: 00000100:00100000:1.0:1790919408.085208:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.085252:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.085501:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132352 00000100:00100000:2.0:1790919408.085507:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132352 00000100:00100000:2.0:1790919408.085549:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790919408.085557:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978132352:12345-0@lo:501: 00000100:00100000:2.0:1790919408.085843:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978132352:12345-0@lo:501: Request processed in 286us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.085850:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790919408.085998:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132352:0@lo:501: 00000100:00100000:1.0:1790919408.086034:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132480:0@lo:503: 00000100:00100000:1.0:1790919408.086097:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.086121:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.086151:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132480 00000100:00100000:3.0:1790919408.086156:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132480 00000100:00100000:3.0:1790919408.086186:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790919408.086193:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978132480:12345-0@lo:503: 00000100:00100000:3.0:1790919408.086435:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978132480:12345-0@lo:503: Request processed in 242us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.086442:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790919408.086452:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132480:0@lo:503: 00000100:00100000:1.0:1790919408.087195:0:9494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9494:1877914978132608:0@lo:502: 00000100:00100000:1.0:1790919408.087246:0:9494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.087287:0:9494:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.087374:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132608 00000100:00100000:0.0:1790919408.087380:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132608 00000100:00100000:0.0:1790919408.087423:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790919408.087431:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9494:x1877914978132608:12345-0@lo:502: 00000100:00100000:0.0:1790919408.087920:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9494:x1877914978132608:12345-0@lo:502: Request processed in 488us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.087929:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790919408.088015:0:9494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9494:1877914978132608:0@lo:502: 00000020:01000000:1.0:1790919408.088039:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790919408.088046:0:9494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1790919408.088084:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919408.088087:0:9494:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790919408.088092:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790919408.088102:0:9494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1790919408.088122:0:9494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790919408.088125:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919408.088147:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff95f3bbb68000) 00000020:00000080:1.0:1790919408.088170:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1790919408.088175:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790919408.088241:0:9494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1790919408.088247:0:9494:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790919408.088256:0:9494:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad15913556 00010000:00080000:1.0:1790919408.088296:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3b64f2000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919408.088545:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1790919408.089049:0:9494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790919408.089135:0:9494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790919408.099225:0:9494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919408.099474:0:9494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919408.099521:0:9494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790919408.099582:0:9494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1790919408.105099:0:9495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919408.105108:0:9495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790919408.111491:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790919408.111506:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790919408.111541:0:9494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790919408.111565:0:9494:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad1591355d 00000100:00080000:3.0:1790919408.111576:0:9494:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919408.111586:0:9494:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f3b64f2000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919408.111927:0:9494:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f284c30a80 x1877914978132736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919408.111954:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790919408.112100:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919408.112104:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919408.112116:0:9494:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790919408.112120:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919408.112123:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919408.112124:0:9494:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790919408.112127:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790919408.112129:0:9494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790919408.112153:0:9494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9494:1877914978132864:0@lo:502: 00000100:00100000:3.0:1790919408.112228:0:9494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919408.112264:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132864 00000100:00100000:3.0:1790919408.112270:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132864 00000100:00100000:3.0:1790919408.112307:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790919408.112316:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9494:x1877914978132864:12345-0@lo:502: 00000100:00100000:1.0:1790919408.112802:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978132736:0@lo:8: 00000100:00100000:1.0:1790919408.112853:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.112944:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132736 00000100:00100000:0.0:1790919408.112949:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132736 00000100:00100000:0.0:1790919408.112978:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919408.112984:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978132736:12345-0@lo:8: 00010000:00080000:0.0:1790919408.113007:0:8082:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1790919408.113029:0:8082:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15913564 00002000:00100000:0.0:1790919408.113041:0:8082:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff95f3a6bab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1790919408.113045:0:8082:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1790919408.113048:0:8082:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790919408.113169:0:8082:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790919408.113317:0:8082:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1790919408.113339:0:8082:0:(import.c:65:import_set_state_nolock()) ffff95f3a6bac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919408.113411:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978132736:12345-0@lo:8: Request processed in 425us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.113428:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790919408.113826:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30a80 x1877914978132736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919408.113836:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919408.113843:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790919408.113850:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919408.113854:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790919408.113856:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b64f2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790919408.113866:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919408.113870:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978132736:0@lo:8: 00000004:00080000:1.0:1790919408.113890:0:9495:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790919408.113983:0:9495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 217141929399ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790919408.114953:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9494:x1877914978132864:12345-0@lo:502: Request processed in 2635us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.114964:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790919408.115018:0:9494:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d1fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.115036:0:9494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9494:1877914978132864:0@lo:502: 00000020:01000000:3.0:1790919408.115101:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919408.115109:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919408.115111:0:9494:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790919408.115116:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1790919408.118376:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1790919408.118410:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790919408.118420:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.118432:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919408.118442:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790919408.118444:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f385571800 from 39 10000000:01000000:0.0:1790919408.118447:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790919408.118481:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.118489:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919408.118499:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919408.118519:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132992:0@lo:101: 00000100:00100000:0.0:1790919408.118583:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.118626:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be000 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.118659:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978133120:0@lo:700: 00000100:00100000:0.0:1790919408.118690:0:9496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.118707:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.125990:0:8092:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133120 00000100:00100000:2.0:1790919408.126003:0:8092:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133120 00000100:00100000:2.0:1790919408.126098:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919408.126108:0:8092:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9496:x1877914978133120:12345-0@lo:700: 00000100:00100000:2.0:1790919408.126169:0:8092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8092:1877914978133248:0@lo:700: 00000100:00100000:2.0:1790919408.126236:0:8092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.126267:0:8092:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444000 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.126287:0:6452:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133248 00000100:00100000:2.0:1790919408.126290:0:6452:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133248 00000100:00100000:2.0:1790919408.126317:0:6452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919408.126323:0:6452:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8092:x1877914978133248:12345-0@lo:700: 00000100:00100000:2.0:1790919408.126985:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978132992 00000100:00100000:2.0:1790919408.126992:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978132992 00000100:00100000:2.0:1790919408.127023:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790919408.127031:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978132992:12345-0@lo:101: 00010000:00010000:2.0:1790919408.127049:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919408.127517:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591356b expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.127546:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591356b expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.127558:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591356b expref: 21 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.127567:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204a200, rc 0) 00000100:00100000:2.0:1790919408.127917:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978132992:12345-0@lo:101: Request processed in 885us (9332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.127924:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790919408.128001:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978133376:0@lo:400: 00000100:00100000:2.0:1790919408.128033:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790919408.128178:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919408.128184:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919408.128270:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978132992:0@lo:101: 00010000:00010000:1.0:1790919408.128287:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.128297:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.128352:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978133504:0@lo:501: 00000100:00100000:1.0:1790919408.128394:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.128438:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f395716300 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.128537:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133504 00000100:00100000:0.0:1790919408.128543:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133504 00000100:00100000:0.0:1790919408.128582:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790919408.128590:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978133504:12345-0@lo:501: 00000100:00100000:0.0:1790919408.128916:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978133504:12345-0@lo:501: Request processed in 326us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.128923:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790919408.128956:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978133504:0@lo:501: 00000100:00100000:0.0:1790919408.128984:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978133632:0@lo:503: 00000100:00100000:0.0:1790919408.129026:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.129043:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.129195:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133376 00000100:00100000:0.0:1790919408.129200:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133376 00000100:00100000:0.0:1790919408.129232:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919408.129239:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978133376:12345-0@lo:400: 00000100:00100000:0.0:1790919408.129274:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978133376:12345-0@lo:400: Request processed in 36us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.129279:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790919408.129875:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc234e00 x1877914978133376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.129888:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978133376:0@lo:400: 00000100:00100000:2.0:1790919408.129912:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133632 00000100:00100000:2.0:1790919408.129916:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133632 00000100:00100000:2.0:1790919408.129942:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790919408.129948:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978133632:12345-0@lo:503: 00000100:00100000:2.0:1790919408.132806:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978133632:12345-0@lo:503: Request processed in 2849us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.132821:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790919408.132919:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978133760:0@lo:400: 00000100:00100000:2.0:1790919408.132961:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.133003:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133760 00000100:00100000:2.0:1790919408.133010:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133760 00000100:00100000:2.0:1790919408.133045:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919408.133068:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978133760:12345-0@lo:400: 00000100:00100000:2.0:1790919408.133126:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978133760:12345-0@lo:400: Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.133132:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919408.133167:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978133760:0@lo:400: 00000100:00100000:2.0:1790919408.133201:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978133888:0@lo:400: 00000100:00100000:2.0:1790919408.133237:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.133271:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978133888 00000100:00100000:2.0:1790919408.133275:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978133888 00000100:00100000:2.0:1790919408.133294:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919408.133299:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978133888:12345-0@lo:400: 00000100:00100000:2.0:1790919408.133332:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978133888:12345-0@lo:400: Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.133338:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919408.133378:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978133888:0@lo:400: 00000100:00100000:2.0:1790919408.133426:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978134016:0@lo:400: 00000100:00100000:2.0:1790919408.133451:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.133481:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134016 00000100:00100000:2.0:1790919408.133485:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134016 00000100:00100000:2.0:1790919408.133508:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919408.133514:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978134016:12345-0@lo:400: 00000100:00100000:2.0:1790919408.133548:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978134016:12345-0@lo:400: Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.133560:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790919408.133589:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf0a680 x1877914978134016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.133599:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978134016:0@lo:400: 00000100:00100000:2.0:1790919408.133628:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978134144:0@lo:400: 00000100:00100000:2.0:1790919408.133651:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.133678:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134144 00000100:00100000:2.0:1790919408.133682:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134144 00000100:00100000:1.0:1790919408.137996:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978133632:0@lo:503: 00000100:00080000:3.0:1790919408.141493:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919408.143033:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790919408.143083:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978134144:12345-0@lo:400: 00000100:00100000:2.0:1790919408.143171:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978134144:12345-0@lo:400: Request processed in 127us (9519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.143680:0:9498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9498:1877914978134784:0@lo:502: 00000100:00100000:1.0:1790919408.143744:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.143779:0:9498:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8600 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.143880:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134784 00000100:00100000:3.0:1790919408.143887:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134784 00000100:00100000:3.0:1790919408.143925:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790919408.143932:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9498:x1877914978134784:12345-0@lo:502: 00000100:00100000:3.0:1790919408.144181:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9498:x1877914978134784:12345-0@lo:502: Request processed in 248us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.144188:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790919408.144506:0:9498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9498:1877914978134784:0@lo:502: 00000100:00100000:1.0:1790919408.144558:0:9498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9498:1877914978134912:0@lo:502: 00000100:00100000:1.0:1790919408.144591:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.144628:0:9498:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382c700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.144724:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134912 00000100:00100000:3.0:1790919408.144729:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134912 00000100:00100000:3.0:1790919408.144761:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790919408.144769:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9498:x1877914978134912:12345-0@lo:502: 00000100:00100000:3.0:1790919408.144918:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9498:x1877914978134912:12345-0@lo:502: Request processed in 149us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.144925:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790919408.145095:0:9498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9498:1877914978134912:0@lo:502: 00000040:00080000:1.0:1790919408.145116:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1790919408.145369:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1790919408.145388:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790919408.145497:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.145510:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919408.145520:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790919408.145524:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f385571800 from 6 10000000:01000000:3.0:1790919408.145526:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790919408.145554:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.145562:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919408.145571:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919408.145584:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135040:0@lo:101: 00000100:00100000:3.0:1790919408.145627:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919408.145655:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.145802:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135040 00000100:00100000:1.0:1790919408.145807:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135040 00000100:00100000:1.0:1790919408.145840:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790919408.145846:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978135040:12345-0@lo:101: 00010000:00010000:1.0:1790919408.145857:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919408.145875:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6486800/0x951c50ad15913580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913579 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.145895:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6486800/0x951c50ad15913580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913579 expref: 22 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.145905:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6486800/0x951c50ad15913580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913579 expref: 22 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.145913:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486800, rc 0) 00000100:00100000:1.0:1790919408.145947:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978135040:12345-0@lo:101: Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.145953:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1790919408.145987:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135040:0@lo:101: 00010000:00010000:1.0:1790919408.145999:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146006:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.146075:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135168:0@lo:256: 00000100:00100000:1.0:1790919408.146116:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.146131:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382c700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.146143:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135168 00000100:00100000:1.0:1790919408.146146:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135168 00000100:00100000:1.0:1790919408.146166:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790919408.146172:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978135168:12345-0@lo:256: 20000000:01000000:1.0:1790919408.146184:0:6439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919408.146201:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919408.146208:0:6439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1790919408.146279:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978135168:12345-0@lo:256: Request processed in 106us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.146285:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790919408.146316:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135168:0@lo:256: 10000000:01000000:1.0:1790919408.146370:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919408.146376:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146383:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919408.146389:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790919408.146392:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1790919408.146394:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919408.146419:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146426:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146434:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.146445:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135296:0@lo:101: 00000100:00100000:1.0:1790919408.146470:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.146483:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.146494:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135296 00000100:00100000:1.0:1790919408.146497:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135296 00000100:00100000:1.0:1790919408.146515:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790919408.146527:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978135296:12345-0@lo:101: 00010000:00010000:1.0:1790919408.146534:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919408.146541:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913587 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146554:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913587 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146562:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913587 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146568:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486600, rc 0) 00000100:00100000:1.0:1790919408.146596:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978135296:12345-0@lo:101: Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.146601:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790919408.146642:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135296:0@lo:101: 00010000:00010000:1.0:1790919408.146652:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919408.146660:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919408.146697:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135424:0@lo:501: 00000100:00100000:1.0:1790919408.146952:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.146967:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.146979:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135424 00000100:00100000:1.0:1790919408.146982:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135424 00000100:00100000:1.0:1790919408.147005:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790919408.147011:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978135424:12345-0@lo:501: 00000100:00100000:1.0:1790919408.147251:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978135424:12345-0@lo:501: Request processed in 240us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.147258:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790919408.147287:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135424:0@lo:501: 00000100:00100000:1.0:1790919408.147313:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135552:0@lo:503: 00000100:00100000:1.0:1790919408.147350:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.147374:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.147384:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135552 00000100:00100000:1.0:1790919408.147387:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135552 00000100:00100000:1.0:1790919408.147503:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790919408.147510:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978135552:12345-0@lo:503: 00000100:00100000:1.0:1790919408.148392:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978135552:12345-0@lo:503: Request processed in 881us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.148655:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790919408.148837:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790919408.148867:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978134272:0@lo:400: 00000100:00100000:2.0:1790919408.148899:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.148930:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919408.148938:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978134400:0@lo:400: 00000100:00100000:2.0:1790919408.148961:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.148992:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978134656:0@lo:400: 00000100:00100000:2.0:1790919408.149015:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790919408.149042:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf0a680 x1877914978134144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.149088:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978134144:0@lo:400: 00000100:00100000:2.0:1790919408.149101:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919408.149117:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978134528:0@lo:400: 00000100:00100000:2.0:1790919408.149140:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.149170:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134400 00000100:00100000:2.0:1790919408.149175:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134400 00000100:00100000:2.0:1790919408.149205:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134528 00000100:00100000:2.0:1790919408.149208:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134528 00000100:00100000:2.0:1790919408.149225:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919408.149232:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978134400:12345-0@lo:400: 00000100:00100000:2.0:1790919408.149274:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978134400:12345-0@lo:400: Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.149280:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919408.149293:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919408.149298:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978134528:12345-0@lo:400: 00000100:00100000:2.0:1790919408.149329:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978134528:12345-0@lo:400: Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.149334:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919408.149350:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134272 00000100:00100000:2.0:1790919408.149353:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134272 00000100:00100000:2.0:1790919408.149390:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978134656 00000100:00100000:2.0:1790919408.149392:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978134656 00000100:00100000:2.0:1790919408.149420:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919408.149426:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978134272:12345-0@lo:400: 00000100:00100000:2.0:1790919408.149455:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978134272:12345-0@lo:400: Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.149461:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919408.149471:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919408.149477:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978134656:12345-0@lo:400: 00000100:00100000:2.0:1790919408.149502:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978134656:12345-0@lo:400: Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.149515:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790919408.149544:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c33b80 x1877914978134400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.149553:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978134400:0@lo:400: 00010000:00080000:2.0:1790919408.149562:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c33100 x1877914978134272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.149570:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978134272:0@lo:400: 00010000:00080000:2.0:1790919408.149590:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32680 x1877914978134528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.149598:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978134528:0@lo:400: 00010000:00080000:2.0:1790919408.149605:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c31500 x1877914978134656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.149833:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978134656:0@lo:400: 00000100:00080000:2.0:1790919408.149853:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919408.153165:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978135552:0@lo:503: 00000100:00100000:1.0:1790919408.154698:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9499:1877914978135680:0@lo:502: 00000100:00100000:1.0:1790919408.154791:0:9499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919408.154836:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.154958:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135680 00000100:00100000:2.0:1790919408.154966:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135680 00000100:00100000:2.0:1790919408.155013:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790919408.155022:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9499:x1877914978135680:12345-0@lo:502: 00000100:00100000:2.0:1790919408.155389:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9499:x1877914978135680:12345-0@lo:502: Request processed in 367us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.155407:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790919408.156789:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aedabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9499:1877914978135680:0@lo:502: 00000020:01000000:1.0:1790919408.156830:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790919408.156837:0:9499:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790919408.156846:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919408.156848:0:9499:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790919408.156854:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790919408.156858:0:9499:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1790919408.156881:0:9499:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790919408.156893:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919408.156909:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95f3bbb699c0) 00000020:00000080:1.0:1790919408.156933:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1790919408.156939:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790919408.157032:0:9499:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790919408.157037:0:9499:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:1.0:1790919408.157043:0:9499:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad1591359c 00010000:00080000:1.0:1790919408.157100:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f38716d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919408.157317:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1790919408.158481:0:9499:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790919408.158502:0:9499:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790919408.159114:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919408.159310:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919408.159370:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790919408.159439:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790919408.164837:0:9500:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919408.164847:0:9500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790919408.167690:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919408.167713:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790919408.167766:0:9499:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790919408.167791:0:9499:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad159135a3 00000100:00080000:2.0:1790919408.167801:0:9499:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919408.167813:0:9499:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f38716d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919408.167844:0:9499:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3bdf08e00 x1877914978135808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919408.167898:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978135808:0@lo:8: 00000100:00100000:1.0:1790919408.167957:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790919408.168021:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1790919408.168048:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135808 00000100:00100000:3.0:1790919408.168090:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135808 00000100:00100000:3.0:1790919408.168131:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919408.168140:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3457:x1877914978135808:12345-0@lo:8: 00010000:00080000:3.0:1790919408.168169:0:8248:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:01000000:2.0:1790919408.168174:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919408.168180:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919408.168182:0:9499:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790919408.168185:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919408.168189:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919408.168191:0:9499:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790919408.168195:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790919408.168197:0:8248:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad159135aa 00000020:00000080:2.0:1790919408.168197:0:9499:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00002000:00100000:3.0:1790919408.168213:0:8248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95f2862ea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790919408.168218:0:8248:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790919408.168221:0:8248:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1790919408.168223:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9499:1877914978135936:0@lo:502: 00000100:00100000:2.0:1790919408.168288:0:9499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1790919408.168315:0:8248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1790919408.168316:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978135936 00000100:00100000:2.0:1790919408.168321:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978135936 00000100:00080000:3.0:1790919408.168341:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f2862ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919408.168351:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790919408.168369:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9499:x1877914978135936:12345-0@lo:502: 00000100:00100000:2.0:1790919408.168570:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9499:x1877914978135936:12345-0@lo:502: Request processed in 211us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.168577:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790919408.168620:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6468c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.168638:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9499:1877914978135936:0@lo:502: 00000020:01000000:2.0:1790919408.168659:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919408.168667:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919408.168669:0:9499:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790919408.168673:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1790919408.168720:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1790919408.168740:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790919408.168749:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.168761:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919408.168771:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790919408.168773:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f3908ab380 from 1 10000000:01000000:2.0:1790919408.168776:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790919408.168796:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.168805:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.168812:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919408.168823:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978136064:0@lo:101: 00000100:00100000:2.0:1790919408.168850:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.168863:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6468c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.168874:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136064 00000100:00100000:2.0:1790919408.168878:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136064 00000100:00100000:2.0:1790919408.168895:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790919408.168900:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978136064:12345-0@lo:101: 00010000:00010000:2.0:1790919408.168908:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919408.168924:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159135b1 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.168944:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159135b1 expref: 24 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.168954:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159135b1 expref: 24 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.168962:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204b800, rc 0) 00000100:00100000:2.0:1790919408.168990:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978136064:12345-0@lo:101: Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.168996:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790919408.169022:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978136064:0@lo:101: 00010000:00010000:2.0:1790919408.169034:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.169042:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919408.169094:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978136192:0@lo:501: 00000100:00100000:2.0:1790919408.169119:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.169131:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6468c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919408.169142:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136192 00000100:00100000:2.0:1790919408.169146:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136192 00000100:00100000:2.0:1790919408.169164:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790919408.169170:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978136192:12345-0@lo:501: 00000100:00100000:2.0:1790919408.169304:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978136192:12345-0@lo:501: Request processed in 133us (183us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919408.169319:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790919408.169349:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978136192:0@lo:501: 10000000:01000000:2.0:1790919408.169384:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790919408.169389:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919408.169396:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919408.172931:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978135808:12345-0@lo:8: Request processed in 4782us (4964us total) trans 0 rc 0/0 00010000:00080000:1.0:1790919408.172931:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf08e00 x1877914978135808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919408.172951:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919408.172951:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919408.172963:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790919408.172972:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919408.172979:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790919408.172983:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f38716d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790919408.177907:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919408.177926:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978135808:0@lo:8: 00000004:00080000:2.0:1790919408.177986:0:9500:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790919408.179072:0:9500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 217207017626ns, next at 0ns, rc = 0 40000000:02000000:2.0:1790919408.203860:0:6452:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:0.0:1790919408.205423:0:7248:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1790919408.214025:0:6452:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8092:x1877914978133248:12345-0@lo:700: Request processed in 87691us (87778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.214040:0:6452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790919408.214119:0:8092:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac0380 x1877914978133248/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.214135:0:8092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8092:1877914978133248:0@lo:700: 40000000:02000000:2.0:1790919408.214148:0:8092:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000001:00100000:0.0:1790919408.263996:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790919408.264013:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790919408.264224:0:8092:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9496:x1877914978133120:12345-0@lo:700: Request processed in 138113us (145528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919408.264235:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790919408.264316:0:9496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24380 x1877914978133120/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919408.264331:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978133120:0@lo:700: 00000004:00080000:1.0:1790919408.267153:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790919408.267846:0:9501:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790919408.267873:0:9501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978136448:0@lo:7: 00000100:00100000:3.0:1790919408.267940:0:9501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919408.267971:0:9501:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382f57f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919408.267991:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136448 00000100:00100000:3.0:1790919408.267997:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136448 00000100:00100000:3.0:1790919408.268080:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919408.268089:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9501:x1877914978136448:12345-0@lo:7: 00000100:00100000:1.0:1790919408.271429:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919408.271455:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978136320:0@lo:13: 00000100:00100000:1.0:1790919408.271530:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919408.272423:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136320 00000100:00100000:3.0:1790919408.272434:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136320 00000100:00100000:3.0:1790919408.272583:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919408.272595:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978136320:12345-0@lo:13: 00002000:00000024:3.0:1790919408.272626:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790919408.272698:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978136320:12345-0@lo:13: Request processed in 106us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.272929:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790919408.272954:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919408.272990:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30000 x1877914978136320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919408.273009:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978136320:0@lo:13: 00002000:00080000:3.0:1790919408.274309:0:8082:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790919408.274315:0:8082:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790919408.274393:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9501:x1877914978136448:12345-0@lo:7: Request processed in 6304us (6451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919408.274402:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790919408.274522:0:9501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30700 x1877914978136448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919408.274547:0:9501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978136448:0@lo:7: 00000004:00080000:0.0:1790919408.274561:0:9501:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790919408.274597:0:9501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978136576:0@lo:5: 00000100:00100000:0.0:1790919408.274632:0:9501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.274667:0:9501:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.274796:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136576 00000100:00100000:1.0:1790919408.274803:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136576 00000100:00100000:1.0:1790919408.274843:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919408.274852:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9501:x1877914978136576:12345-0@lo:5: 00002000:00080000:1.0:1790919408.274875:0:8084:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790919408.274878:0:8084:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1790919408.275205:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9501:x1877914978136576:12345-0@lo:5: Request processed in 354us (571us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790919408.275212:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790919408.275347:0:9501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3ae84a300 x1877914978136576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919408.275369:0:9501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978136576:0@lo:5: 00000004:00080000:0.0:1790919408.275378:0:9501:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790919408.275403:0:9501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978136704:0@lo:700: 00000100:00100000:0.0:1790919408.275428:0:9501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.275454:0:9501:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.275604:0:8091:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136704 00000100:00100000:1.0:1790919408.275610:0:8091:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136704 00000100:00100000:1.0:1790919408.275641:0:8091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919408.275648:0:8091:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9501:x1877914978136704:12345-0@lo:700: 00000004:00080000:0.0:1790919408.324726:0:9496:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790919408.324823:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978136960:0@lo:7: 00000100:00100000:0.0:1790919408.324889:0:9496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.324919:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.324950:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919408.324961:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978136832:0@lo:13: 00000100:00100000:0.0:1790919408.324986:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919408.325016:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136960 00000100:00100000:0.0:1790919408.325023:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136960 00000100:00100000:0.0:1790919408.325082:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919408.325092:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9496:x1877914978136960:12345-0@lo:7: 00002000:00080000:0.0:1790919408.330103:0:8083:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1790919408.330115:0:8083:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790919408.330286:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9496:x1877914978136960:12345-0@lo:7: Request processed in 5192us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.330296:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919408.330338:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978136832 00000100:00100000:0.0:1790919408.330346:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978136832 00000100:00100000:0.0:1790919408.330398:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919408.330406:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978136832:12345-0@lo:13: 00002000:00000024:0.0:1790919408.330427:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790919408.330476:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978136832:12345-0@lo:13: Request processed in 70us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919408.330491:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790919408.330690:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f391514e00 x1877914978136832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919408.330710:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978136832:0@lo:13: 00010000:00080000:2.0:1790919408.334604:0:9496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f391514380 x1877914978136960/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.334623:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978136960:0@lo:7: 00000004:00080000:2.0:1790919408.334650:0:9496:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790919408.334707:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978137088:0@lo:5: 00000100:00100000:2.0:1790919408.334770:0:9496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.334799:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac60bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.334882:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137088 00000100:00100000:1.0:1790919408.334890:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137088 00000100:00100000:1.0:1790919408.334933:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919408.334941:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9496:x1877914978137088:12345-0@lo:5: 00002000:00080000:1.0:1790919408.334968:0:8084:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1790919408.335014:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9496:x1877914978137088:12345-0@lo:5: Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.335020:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790919408.335129:0:9496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf0b800 x1877914978137088/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.335138:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978137088:0@lo:5: 00000004:00080000:2.0:1790919408.335145:0:9496:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790919408.335165:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978137216:0@lo:5: 00000100:00100000:2.0:1790919408.335185:0:9496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.335209:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac60bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.335252:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137216 00000100:00100000:1.0:1790919408.335255:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137216 00000100:00100000:1.0:1790919408.335283:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919408.335288:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9496:x1877914978137216:12345-0@lo:5: 00002000:00080000:1.0:1790919408.335315:0:8083:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1790919408.337706:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9496:x1877914978137216:12345-0@lo:5: Request processed in 2412us (2515us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790919408.337722:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790919408.338023:0:9496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf0b800 x1877914978137216/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.338038:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9496:1877914978137216:0@lo:5: 00000004:00080000:2.0:1790919408.338075:0:9496:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790919408.338111:0:9496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9496:1877914978137344:0@lo:900: 00000100:00100000:2.0:1790919408.338141:0:9496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919408.338163:0:9496:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac60bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919408.338866:0:6457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137344 00000100:00100000:1.0:1790919408.338874:0:6457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137344 00000100:00100000:1.0:1790919408.338916:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919408.338924:0:6457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9496:x1877914978137344:12345-0@lo:900: 00000100:00100000:1.0:1790919408.338979:0:6457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9496:x1877914978137344:12345-0@lo:900: Request processed in 56us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.338985:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790919408.339187:0:9496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf09180 x1877914978137344/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919408.339198:0:9496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9496:1877914978137344:0@lo:900: 00000001:00080000:0.0:1790919408.340430:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1790919408.340552:0:8091:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9501:x1877914978136704:12345-0@lo:700: Request processed in 64903us (65121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919408.340561:0:8091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790919408.340684:0:9501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24380 x1877914978136704/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919408.340693:0:9501:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790919408.340706:0:9501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978136704:0@lo:700: 00000004:02000040:3.0:1790919408.359177:0:9501:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1790919408.361870:0:9501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978137472:0@lo:5: 00000100:00100000:3.0:1790919408.361934:0:9501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919408.361966:0:9501:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386445000 going to sleep for 11 seconds 00000100:00100000:0.0:1790919408.362169:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137472 00000100:00100000:0.0:1790919408.362177:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137472 00000100:00100000:0.0:1790919408.362222:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919408.362229:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9501:x1877914978137472:12345-0@lo:5: 00002000:00080000:0.0:1790919408.366946:0:8084:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790919408.366967:0:8084:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1790919408.369573:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9501:x1877914978137472:12345-0@lo:5: Request processed in 7338us (7632us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790919408.369585:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1790919408.369704:0:9501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30000 x1877914978137472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919424 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919408.369722:0:9501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9501:1877914978137472:0@lo:5: 00000004:00080000:3.0:1790919408.369736:0:9501:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1790919409.052171:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919410.080966:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919410.627896:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1790919410.627930:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1790919411.101597:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919411.612497:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978137728:0@lo:41: 00000100:00100000:3.0:1790919411.612578:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919411.612665:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919411.612672:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978137600:0@lo:41: 00000100:00100000:3.0:1790919411.612701:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919411.612791:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137728 00000100:00100000:2.0:1790919411.612800:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137728 00000100:00100000:2.0:1790919411.612863:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137600 00000100:00100000:2.0:1790919411.612867:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137600 00000100:00100000:2.0:1790919411.612894:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790919411.612903:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978137728:12345-0@lo:41: 00000004:00000024:2.0:1790919411.612941:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919411.612991:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978137728:12345-0@lo:41: Request processed in 89us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919411.612999:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790919411.613015:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919411.613021:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978137600:12345-0@lo:41: 00000004:00000024:2.0:1790919411.613040:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919411.613109:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978137600:12345-0@lo:41: Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919411.613115:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919411.613164:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978137600:0@lo:41: 00000100:00100000:2.0:1790919411.613177:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978137728:0@lo:41: 00000100:00100000:3.0:1790919412.108526:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.108603:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958168448 00000100:00100000:2.0:1790919412.108613:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958168448 00000100:00100000:2.0:1790919412.108660:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:2.0:1790919412.108668:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2410:x1877914958168448:12345-192.168.203.11@tcp:250: 00010000:00080000:2.0:1790919412.108695:0:6439:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a8157f22-2e62-481b-a08b-6545627fb184@192.168.203.11@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1790919412.108720:0:6439:0:(genops.c:1384:class_connect()) connect: client a8157f22-2e62-481b-a08b-6545627fb184, cookie 0x951c50ad159135bf 00000100:00080000:2.0:1790919412.108852:0:6439:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919412.108926:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+5:2410:x1877914958168448:12345-192.168.203.11@tcp:250: Request processed in 257us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.108933:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:0.0:1790919412.111705:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.111907:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958168320 00000100:00100000:2.0:1790919412.111916:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958168320 00000100:00100000:2.0:1790919412.111968:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:2.0:1790919412.111976:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+5:6372:x1877914958168320:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1790919412.112152:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919412.112170:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38a9c expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.112197:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 6 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.112209:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 6 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.112217:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204be00, rc 0) 00000100:00100000:2.0:1790919412.112268:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+6:6372:x1877914958168320:12345-192.168.203.11@tcp:101: Request processed in 293us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.112275:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:1.0:1790919412.114158:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919412.114287:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958168576 00000100:00100000:0.0:1790919412.114296:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958168576 00000100:00100000:0.0:1790919412.114354:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:0.0:1790919412.114364:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+6:6372:x1877914958168576:12345-192.168.203.11@tcp:501: 00000100:00100000:0.0:1790919412.114701:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+6:6372:x1877914958168576:12345-192.168.203.11@tcp:501: Request processed in 338us (547us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919412.114709:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:3.0:1790919412.116889:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.117029:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958168704 00000100:00100000:2.0:1790919412.117037:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958168704 00000100:00100000:2.0:1790919412.117115:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1790919412.117125:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+6:6372:x1877914958168704:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1790919412.117141:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919412.117158:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38aa3 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.117185:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 7 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.117214:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 7 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.117222:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204b000, rc 0) 00000100:00100000:2.0:1790919412.117277:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+7:6372:x1877914958168704:12345-192.168.203.11@tcp:101: Request processed in 154us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.117284:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:1.0:1790919412.119460:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.119551:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958168832 00000100:00100000:2.0:1790919412.119559:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958168832 00000100:00100000:2.0:1790919412.119613:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:2.0:1790919412.119622:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+7:6372:x1877914958168832:12345-192.168.203.11@tcp:501: 00000100:00100000:2.0:1790919412.120120:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+8:6372:x1877914958168832:12345-192.168.203.11@tcp:501: Request processed in 496us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.120128:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1790919412.123874:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919412.124006:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958168960 00000100:00100000:0.0:1790919412.124015:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958168960 00000100:00100000:0.0:1790919412.124098:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:0.0:1790919412.124106:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+8:6372:x1877914958168960:12345-192.168.203.11@tcp:503: 00000100:00100000:0.0:1790919412.124641:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+8:6372:x1877914958168960:12345-192.168.203.11@tcp:503: Request processed in 534us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.124649:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:3.0:1790919412.125764:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919412.125782:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978137856:0@lo:13: 00000100:00100000:3.0:1790919412.125831:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919412.125952:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137856 00000100:00100000:3.0:1790919412.125958:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137856 00000100:00100000:3.0:1790919412.126121:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919412.126146:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978137856:12345-0@lo:13: 00002000:00000024:3.0:1790919412.126175:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919412.126212:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978137856:12345-0@lo:13: Request processed in 84us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919412.126219:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790919412.126237:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919412.126261:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32d80 x1877914978137856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919412.126278:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978137856:0@lo:13: 00000100:00100000:2.0:1790919412.126508:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919412.126517:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aeda9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978137984:0@lo:13: 00000100:00100000:2.0:1790919412.126546:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919412.126622:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919412.126633:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978137984 00000100:00100000:0.0:1790919412.126637:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978137984 00000100:00100000:0.0:1790919412.126676:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919412.126681:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978137984:12345-0@lo:13: 00002000:00000024:0.0:1790919412.126690:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919412.126720:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978137984:12345-0@lo:13: Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.126725:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1790919412.126777:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790919412.126796:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aeda9500 x1877914978137984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919412.126808:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aeda9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978137984:0@lo:13: 00000100:00100000:3.0:1790919412.130463:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.130566:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169088 00000100:00100000:2.0:1790919412.130576:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169088 00000100:00100000:2.0:1790919412.130629:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:2.0:1790919412.130639:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+8:6392:x1877914958169088:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1790919412.130994:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+8:6392:x1877914958169088:12345-192.168.203.11@tcp:502: Request processed in 355us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.131001:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:1.0:1790919412.164091:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.164268:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169216 00000100:00100000:2.0:1790919412.164278:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169216 00000100:00100000:2.0:1790919412.164344:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:2.0:1790919412.164353:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+8:6392:x1877914958169216:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1790919412.164621:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+8:6392:x1877914958169216:12345-192.168.203.11@tcp:502: Request processed in 268us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.164630:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:1.0:1790919412.168286:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919412.168400:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169344 00000100:00100000:0.0:1790919412.168411:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169344 00000100:00100000:0.0:1790919412.168478:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:0.0:1790919412.168488:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+8:6372:x1877914958169344:12345-192.168.203.11@tcp:101: 00010000:00010000:0.0:1790919412.168506:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919412.168525:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014600/0x951c50ad159135d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ad4 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919412.168550:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014600/0x951c50ad159135d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ad4 expref: 9 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919412.168560:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014600/0x951c50ad159135d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ad4 expref: 9 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919412.168569:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014600, rc 0) 00000100:00100000:0.0:1790919412.168623:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+9:6372:x1877914958169344:12345-192.168.203.11@tcp:101: Request processed in 136us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.168630:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:3.0:1790919412.172268:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919412.172394:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169472 00000100:00100000:0.0:1790919412.172404:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169472 00000100:00100000:0.0:1790919412.172461:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:0.0:1790919412.172470:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+9:6372:x1877914958169472:12345-192.168.203.11@tcp:256: 20000000:01000000:0.0:1790919412.172494:0:6439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790919412.172520:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790919412.172524:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790919412.172527:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790919412.172530:0:6439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790919412.172532:0:6439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1790919412.177634:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+9:6372:x1877914958169472:12345-192.168.203.11@tcp:256: Request processed in 5151us (5362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.177662:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:1.0:1790919412.181222:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.181362:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169600 00000100:00100000:2.0:1790919412.181381:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169600 00000100:00100000:2.0:1790919412.181440:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:2.0:1790919412.181450:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+9:6372:x1877914958169600:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1790919412.181468:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919412.181486:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38adb expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.181511:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.181521:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919412.181529:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204aa00, rc 0) 00000100:00100000:2.0:1790919412.181584:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:6372:x1877914958169600:12345-192.168.203.11@tcp:101: Request processed in 136us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.181604:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:3.0:1790919412.184564:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919412.184969:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169728 00000100:00100000:0.0:1790919412.184979:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169728 00000100:00100000:0.0:1790919412.185043:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:0.0:1790919412.185077:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6372:x1877914958169728:12345-192.168.203.11@tcp:501: 00000100:00100000:0.0:1790919412.185365:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6372:x1877914958169728:12345-192.168.203.11@tcp:501: Request processed in 313us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.185373:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1790919412.197672:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919412.197949:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169856 00000100:00100000:0.0:1790919412.197959:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169856 00000100:00100000:0.0:1790919412.198038:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1790919412.198047:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6372:x1877914958169856:12345-192.168.203.11@tcp:503: 00000100:00100000:0.0:1790919412.198465:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6372:x1877914958169856:12345-192.168.203.11@tcp:503: Request processed in 418us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.198473:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:1.0:1790919412.203518:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.203621:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958169984 00000100:00100000:2.0:1790919412.203631:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958169984 00000100:00100000:2.0:1790919412.203722:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1790919412.203741:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:6397:x1877914958169984:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1790919412.204216:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:6397:x1877914958169984:12345-192.168.203.11@tcp:502: Request processed in 474us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.204223:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:1.0:1790919412.207967:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919412.208075:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170112 00000100:00100000:2.0:1790919412.208085:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170112 00000100:00100000:2.0:1790919412.209960:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:2.0:1790919412.209979:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:6397:x1877914958170112:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1790919412.210582:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:6397:x1877914958170112:12345-192.168.203.11@tcp:502: Request processed in 610us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919412.210591:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:1.0:1790919412.215460:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919412.215500:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919412.215635:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170240 00000100:00100000:3.0:1790919412.215645:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170240 00000100:00100000:3.0:1790919412.215684:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170496 00000100:00100000:3.0:1790919412.215687:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170496 00000100:00100000:3.0:1790919412.215740:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919412.215762:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1877914958170240:12345-192.168.203.11@tcp:38: 00010000:00080000:3.0:1790919412.215791:0:6445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1790919412.215834:0:6445:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad159135e2 00000004:00100000:3.0:1790919412.215861:0:6445:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790919412.216242:0:6445:0:(import.c:65:import_set_state_nolock()) ffff95f398dc9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919412.216311:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958170240:12345-192.168.203.11@tcp:38: Request processed in 549us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919412.216319:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790919412.216347:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1790919412.216355:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2410:x1877914958170496:12345-192.168.203.11@tcp:38: 00010000:00080000:0.0:1790919412.216371:0:6446:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1790919412.216405:0:6446:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad159135e9 00000004:00100000:0.0:1790919412.216421:0:6446:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790919412.216648:0:6446:0:(import.c:65:import_set_state_nolock()) ffff95f3a6bae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919412.216676:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958170496:12345-192.168.203.11@tcp:38: Request processed in 320us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919412.222020:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00010000:00010000:3.0:1790919413.149078:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919413.226135:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919413.226184:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919413.226403:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170752 00000100:00100000:3.0:1790919413.226413:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170752 00000100:00100000:3.0:1790919413.226483:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170368 00000100:00100000:3.0:1790919413.226487:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170368 00000100:00100000:3.0:1790919413.226507:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790919413.226517:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:6372:x1877914958170752:12345-192.168.203.11@tcp:41: 00000004:00000024:3.0:1790919413.226558:0:6445:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919413.226621:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:6372:x1877914958170752:12345-192.168.203.11@tcp:41: Request processed in 105us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919413.226629:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1790919413.226646:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790919413.226653:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958170368:12345-192.168.203.11@tcp:41: 00000004:00000024:3.0:1790919413.226664:0:6445:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919413.226686:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958170368:12345-192.168.203.11@tcp:41: Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919413.226692:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:0.0:1790919413.226862:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919413.226966:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919413.227170:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170624 00000100:00100000:0.0:1790919413.227175:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170624 00000100:00100000:0.0:1790919413.227226:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790919413.227234:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958170624:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1790919413.227266:0:6445:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919413.227300:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958170624:12345-192.168.203.11@tcp:41: Request processed in 67us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.227307:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:1.0:1790919413.227580:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919413.229824:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919413.230784:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958170880 00000100:00100000:3.0:1790919413.230805:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958170880 00000100:00100000:3.0:1790919413.230874:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1790919413.230885:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6372:x1877914958170880:12345-192.168.203.11@tcp:40: 00000100:00100000:3.0:1790919413.230974:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6372:x1877914958170880:12345-192.168.203.11@tcp:40: Request processed in 91us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919413.230982:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790919413.232870:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919413.232920:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919413.232992:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171392 00000100:00100000:0.0:1790919413.233002:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171392 00000100:00100000:0.0:1790919413.233090:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:0.0:1790919413.233101:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958171392:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1790919413.233249:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958171392:12345-192.168.203.11@tcp:400: Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.233449:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1790919413.233551:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919413.233681:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919413.233706:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171008 00000100:00100000:1.0:1790919413.233711:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171008 00000100:00100000:1.0:1790919413.233728:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171136 00000100:00100000:1.0:1790919413.233731:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171136 00000100:00100000:1.0:1790919413.233743:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790919413.233748:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958171008:12345-192.168.203.11@tcp:8: 00010000:00080000:1.0:1790919413.233774:0:8248:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1790919413.233801:0:8248:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad159135f0 00002000:00100000:1.0:1790919413.233813:0:8248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fd078e75-25ee-44fe-89dc-39e9cfa5e4b5/ffff95f38716a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919413.233823:0:8248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1790919413.234394:0:6457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171264 00000100:00100000:2.0:1790919413.234401:0:6457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171264 00000100:00100000:2.0:1790919413.234439:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919413.234447:0:6457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6372:x1877914958171264:12345-192.168.203.11@tcp:900: 00000100:00100000:2.0:1790919413.234502:0:6457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6372:x1877914958171264:12345-192.168.203.11@tcp:900: Request processed in 56us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919413.234509:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919413.234532:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919413.234537:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2410:x1877914958171136:12345-192.168.203.11@tcp:8: 00010000:00080000:2.0:1790919413.234555:0:8083:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1790919413.234586:0:8083:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad159135f7 00002000:00100000:2.0:1790919413.234592:0:8083:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fd078e75-25ee-44fe-89dc-39e9cfa5e4b5/ffff95f3b65b6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919413.234607:0:8083:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919413.235456:0:8248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790919413.235488:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f38716a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919413.235541:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958171008:12345-192.168.203.11@tcp:8: Request processed in 1790us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919413.235549:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00002000:00080000:2.0:1790919413.236650:0:8083:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790919413.236681:0:8083:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919413.236721:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958171136:12345-192.168.203.11@tcp:8: Request processed in 2180us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919413.236729:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790919413.238804:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919413.238905:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171520 00000100:00100000:1.0:1790919413.238915:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171520 00000100:00100000:1.0:1790919413.238972:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790919413.238982:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6372:x1877914958171520:12345-192.168.203.11@tcp:33: 00000004:00080000:2.0:1790919413.273407:0:6448:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34355us 00000004:00200000:1.0:1790919413.303794:0:6448:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790919413.303959:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6372:x1877914958171520:12345-192.168.203.11@tcp:33: Request processed in 64968us (65153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919413.303971:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790919413.492096:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919413.492243:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171648 00000100:00100000:3.0:1790919413.492257:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171648 00000100:00100000:3.0:1790919413.492342:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790919413.492354:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6415:x1877914958171648:12345-192.168.203.11@tcp:101: 00010000:00010000:3.0:1790919413.492382:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919413.492412:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d000/0x951c50ad159135fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b0c expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919413.492498:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913605 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919413.492516:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919413.492805:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919413.492852:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919413.492857:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919413.492877:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919413.492907:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d000/0x951c50ad159135fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b0c expref: 8 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919413.492944:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b0c expref: 7 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919413.492954:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5200) 00010000:00010000:3.0:1790919413.492957:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919413.492960:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2de00, rc 0) 00000100:00100000:3.0:1790919413.493148:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:6415:x1877914958171648:12345-192.168.203.11@tcp:101: Request processed in 789us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919413.493154:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790919413.660241:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919413.660268:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978138112:0@lo:13: 00000100:00100000:2.0:1790919413.660350:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919413.660419:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978138240:0@lo:400: 00000100:00100000:2.0:1790919413.660461:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.660478:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978138624:0@lo:400: 00000100:00100000:2.0:1790919413.660494:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978138752:0@lo:400: 00000100:00100000:3.0:1790919413.660551:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978138496:0@lo:400: 00000100:00100000:0.0:1790919413.660591:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919413.660592:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919413.660605:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978138368:0@lo:400: 00000100:00100000:1.0:1790919413.661221:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138112 00000100:00100000:1.0:1790919413.661230:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138112 00000100:00100000:1.0:1790919413.661285:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919413.661295:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978138112:12345-0@lo:13: 00002000:00000024:1.0:1790919413.661328:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919413.664704:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138240 00000100:00100000:2.0:1790919413.664718:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138240 00000100:00100000:2.0:1790919413.664772:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790919413.664782:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978138240:12345-0@lo:400: 00000100:00100000:2.0:1790919413.664865:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978138240:12345-0@lo:400: Request processed in 85us (4404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919413.664871:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790919413.664920:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978139264:0@lo:400: 00000100:00100000:2.0:1790919413.664956:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919413.665331:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978138240:0@lo:400: 00000100:00100000:2.0:1790919413.665358:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978139776:0@lo:13: 00000100:00100000:3.0:1790919413.665686:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.668994:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138624 00000100:00100000:0.0:1790919413.669016:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138624 00000100:00100000:0.0:1790919413.669121:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790919413.669133:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978138624:12345-0@lo:400: 00000100:00100000:0.0:1790919413.669239:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978138624:12345-0@lo:400: Request processed in 108us (8667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.669248:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790919413.669281:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139264 00000100:00100000:0.0:1790919413.669439:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139264 00000100:00100000:0.0:1790919413.669494:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919413.669504:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978139264:12345-0@lo:400: 00000100:00100000:0.0:1790919413.669566:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978139264:12345-0@lo:400: Request processed in 64us (4608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.669574:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919413.669616:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.669661:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978139008:0@lo:400: 00000100:00100000:0.0:1790919413.669702:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.669747:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978139520:0@lo:400: 00000100:00100000:0.0:1790919413.670114:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.670163:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138496 00000100:00100000:0.0:1790919413.670168:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138496 00000100:00100000:0.0:1790919413.670199:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919413.670205:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978138496:12345-0@lo:400: 00000100:00100000:0.0:1790919413.670248:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978138496:12345-0@lo:400: Request processed in 42us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.670254:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919413.670302:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978138496:0@lo:400: 00000100:00100000:0.0:1790919413.670339:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138752 00000100:00100000:0.0:1790919413.670343:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138752 00000100:00100000:0.0:1790919413.670363:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138368 00000100:00100000:0.0:1790919413.670365:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138368 00000100:00100000:0.0:1790919413.670377:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139008 00000100:00100000:0.0:1790919413.670379:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139008 00000100:00100000:0.0:1790919413.670393:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139520 00000100:00100000:0.0:1790919413.670396:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139520 00000100:00100000:0.0:1790919413.670408:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790919413.670414:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978138752:12345-0@lo:400: 00000100:00100000:0.0:1790919413.670559:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978138752:12345-0@lo:400: Request processed in 144us (9986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.670566:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790919413.670581:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790919413.670586:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978138368:12345-0@lo:400: 00000100:00100000:0.0:1790919413.670624:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978138368:12345-0@lo:400: Request processed in 38us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.670630:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790919413.670642:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790919413.670650:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978139008:12345-0@lo:400: 00000100:00100000:0.0:1790919413.670696:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978139008:12345-0@lo:400: Request processed in 46us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.670702:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790919413.670843:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790919413.670853:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978139520:12345-0@lo:400: 00000100:00100000:0.0:1790919413.670894:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978139520:12345-0@lo:400: Request processed in 43us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.670901:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1790919413.670942:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32a00 x1877914978139008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919413.670955:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978139008:0@lo:400: 00010000:00080000:0.0:1790919413.670965:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebc000 x1877914978139520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919413.670975:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978139520:0@lo:400: 00000100:00100000:0.0:1790919413.671025:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978138624:0@lo:400: 00000100:00100000:0.0:1790919413.671041:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978139136:0@lo:400: 00000100:00100000:0.0:1790919413.671100:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.671127:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978139648:0@lo:400: 00000100:00100000:0.0:1790919413.671150:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919413.671184:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139136 00000100:00100000:0.0:1790919413.671190:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139136 00000100:00100000:0.0:1790919413.671214:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139648 00000100:00100000:0.0:1790919413.671217:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139648 00000100:00100000:0.0:1790919413.671244:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919413.671255:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978139136:12345-0@lo:400: 00000100:00100000:0.0:1790919413.671298:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978139136:12345-0@lo:400: Request processed in 47us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.671304:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919413.671332:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919413.671343:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978139648:12345-0@lo:400: 00000100:00100000:0.0:1790919413.671384:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978139648:12345-0@lo:400: Request processed in 45us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919413.671390:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790919413.671447:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32300 x1877914978139136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919413.671530:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978139136:0@lo:400: 00010000:00080000:0.0:1790919413.671550:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebc700 x1877914978139648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919413.671558:0:3458:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1790919413.671589:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978139648:0@lo:400: 00000100:00080000:0.0:1790919413.671913:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919413.671919:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919413.672424:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978138112:12345-0@lo:13: Request processed in 11119us (12064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919413.672440:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919413.678900:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919413.678948:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139776 00000100:00100000:2.0:1790919413.678958:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139776 00000100:00100000:2.0:1790919413.679005:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919413.679013:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978139776:12345-0@lo:13: 00002000:00000024:2.0:1790919413.679039:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919413.679105:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978139776:12345-0@lo:13: Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919413.679113:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790919413.679248:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5880 x1877914978139776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919413.679267:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978139776:0@lo:13: 00000100:00100000:2.0:1790919413.679287:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978138752:0@lo:400: 00010000:00080000:2.0:1790919413.679300:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c31180 x1877914978139264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919413.679308:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978139264:0@lo:400: 00010000:00080000:2.0:1790919413.679330:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf0aa00 x1877914978138112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919413.679338:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790919413.679357:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978138112:0@lo:13: 00000100:00100000:3.0:1790919413.688421:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978138368:0@lo:400: 00000100:00100000:3.0:1790919413.688437:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978138880:0@lo:400: 00000100:00100000:3.0:1790919413.688494:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919413.688910:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978138880 00000100:00100000:3.0:1790919413.689108:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978138880 00000100:00100000:3.0:1790919413.689245:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919413.689256:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978138880:12345-0@lo:400: 00000100:00100000:3.0:1790919413.689311:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978138880:12345-0@lo:400: Request processed in 58us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919413.689330:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1790919413.689354:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919413.689390:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978138880:0@lo:400: 00000100:00100000:3.0:1790919413.689408:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978139392:0@lo:400: 00000100:00100000:3.0:1790919413.689441:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919413.689463:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139392 00000100:00100000:3.0:1790919413.689466:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139392 00000100:00100000:3.0:1790919413.689499:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790919413.689506:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978139392:12345-0@lo:400: 00000100:00100000:3.0:1790919413.689955:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978139392:12345-0@lo:400: Request processed in 448us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919413.689963:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1790919413.689980:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919413.690001:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978139392:0@lo:400: 00000001:00100000:1.0:1790919413.710239:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000001:00100000:0.0:1790919413.719222:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00010000:00010000:0.0:1790919414.172306:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919415.198101:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919415.561124:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919415.561594:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171776 00000100:00100000:0.0:1790919415.561615:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171776 00000100:00080000:3.0:1790919415.561696:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919415.561728:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1790919415.561744:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6467:x1877914958171776:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1790919415.561810:0:6446:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919415.561927:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6467:x1877914958171776:12345-192.168.203.11@tcp:41: Request processed in 186us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919415.561936:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1790919415.566207:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919415.566376:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958171904 00000100:00100000:3.0:1790919415.566390:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958171904 00000100:00100000:3.0:1790919415.566551:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:3.0:1790919415.566565:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:6467:x1877914958171904:12345-192.168.203.11@tcp:41: 00000004:00000024:3.0:1790919415.566632:0:6447:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919415.566733:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:6467:x1877914958171904:12345-192.168.203.11@tcp:41: Request processed in 171us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919415.566742:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:0.0:1790919415.567677:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919415.573449:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919415.573666:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172032 00000100:00100000:1.0:1790919415.573679:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172032 00000100:00100000:1.0:1790919415.573820:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790919415.573832:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6467:x1877914958172032:12345-192.168.203.11@tcp:13: 00002000:00000024:1.0:1790919415.573897:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919415.573993:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6467:x1877914958172032:12345-192.168.203.11@tcp:13: Request processed in 163us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919415.574002:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00080000:0.0:1790919415.577328:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919415.578903:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919415.579276:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172160 00000100:00100000:2.0:1790919415.579292:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172160 00000100:00100000:2.0:1790919415.579414:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919415.579428:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6467:x1877914958172160:12345-192.168.203.11@tcp:13: 00002000:00000024:2.0:1790919415.579493:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919415.579599:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:6467:x1877914958172160:12345-192.168.203.11@tcp:13: Request processed in 173us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919415.579608:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00080000:0.0:1790919415.579964:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1790919415.761552:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00010000:00010000:3.0:1790919416.222256:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919416.732332:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919416.732357:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978139904:0@lo:41: 00000100:00100000:0.0:1790919416.732448:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919416.735395:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978139904 00000100:00100000:2.0:1790919416.735411:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978139904 00000100:00100000:2.0:1790919416.735486:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919416.735496:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978139904:12345-0@lo:41: 00000004:00000024:2.0:1790919416.735541:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919416.735622:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978139904:12345-0@lo:41: Request processed in 128us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919416.735629:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919416.737332:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978139904:0@lo:41: 00000100:00100000:3.0:1790919416.737517:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919416.737537:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978140032:0@lo:41: 00000100:00100000:3.0:1790919416.737591:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919416.743278:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140032 00000100:00100000:0.0:1790919416.743304:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140032 00000100:00100000:0.0:1790919416.743366:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790919416.743392:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978140032:12345-0@lo:41: 00000004:00000024:0.0:1790919416.743592:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919416.743822:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978140032:12345-0@lo:41: Request processed in 433us (6228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919416.743839:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919416.744377:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978140032:0@lo:41: 00000001:00100000:0.0:1790919416.807488:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00010000:00010000:3.0:1790919417.244441:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919417.244555:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919417.244577:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978140160:0@lo:13: 00000100:00100000:1.0:1790919417.244650:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919417.244706:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140160 00000100:00100000:1.0:1790919417.244713:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140160 00000100:00100000:1.0:1790919417.244763:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790919417.244772:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978140160:12345-0@lo:13: 00002000:00000024:1.0:1790919417.244803:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919417.244844:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978140160:12345-0@lo:13: Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919417.244861:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790919417.244883:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919417.244914:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c7b80 x1877914978140160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919417.244931:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978140160:0@lo:13: 00000100:00100000:1.0:1790919417.245687:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978140288:0@lo:13: 00000100:00100000:1.0:1790919417.245722:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919417.245760:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140288 00000100:00100000:1.0:1790919417.245765:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140288 00000100:00100000:1.0:1790919417.245802:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790919417.245809:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978140288:12345-0@lo:13: 00002000:00000024:1.0:1790919417.245821:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919417.245853:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978140288:12345-0@lo:13: Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919417.245860:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1790919417.245875:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919417.245895:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebe300 x1877914978140288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919417.245909:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978140288:0@lo:13: 00000001:02000400:2.0:1790919417.777890:0:9704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790919418.268280:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919418.313217:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919418.313358:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172288 00000100:00100000:0.0:1790919418.313369:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172288 00000100:00100000:0.0:1790919418.313434:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1790919418.313445:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2411:x1877914958172288:12345-192.168.203.11@tcp:400: 00000100:00100000:3.0:1790919418.313460:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919418.313529:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2411:x1877914958172288:12345-192.168.203.11@tcp:400: Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919418.313537:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1790919418.313785:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919418.313826:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919418.313866:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172800 00000100:00100000:2.0:1790919418.313871:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172800 00000100:00100000:2.0:1790919418.313923:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790919418.313930:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958172800:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1790919418.313969:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958172800:12345-192.168.203.11@tcp:400: Request processed in 39us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919418.313976:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00080000:3.0:1790919418.314733:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919418.318736:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172544 00000100:00100000:3.0:1790919418.318958:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172416 00000100:00100000:3.0:1790919418.318964:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172416 00000100:00100000:3.0:1790919418.319036:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:3.0:1790919418.319082:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958172416:12345-192.168.203.11@tcp:400: 00000100:00080000:2.0:1790919418.319083:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919418.319164:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958172416:12345-192.168.203.11@tcp:400: Request processed in 119us (5336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.319172:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790919418.319226:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919418.319489:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172544 00000100:00100000:1.0:1790919418.320619:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790919418.320631:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958172544:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1790919418.320695:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958172544:12345-192.168.203.11@tcp:400: Request processed in 66us (7236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919418.320718:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1790919418.321303:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172672 00000100:00100000:3.0:1790919418.321312:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172672 00000100:00080000:2.0:1790919418.321360:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919418.321400:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919418.322157:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790919418.322169:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958172672:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1790919418.322279:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958172672:12345-192.168.203.11@tcp:400: Request processed in 113us (3607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919418.322296:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790919418.780296:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978140416:0@lo:400: 00000100:00100000:3.0:1790919418.780370:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.780432:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978140928:0@lo:400: 00000100:00100000:3.0:1790919418.780464:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.780486:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978141440:0@lo:400: 00000100:00100000:3.0:1790919418.780513:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.780530:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978141952:0@lo:400: 00000100:00100000:3.0:1790919418.780554:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.780580:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790919418.780588:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978140544:0@lo:400: 00000100:00100000:3.0:1790919418.780621:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.780855:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978141056:0@lo:400: 00000100:00100000:3.0:1790919418.780884:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.780903:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978141568:0@lo:400: 00000100:00100000:1.0:1790919418.780906:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140928 00000100:00100000:1.0:1790919418.780915:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140928 00000100:00100000:3.0:1790919418.780929:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919418.781038:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978140672:0@lo:400: 00000100:00100000:2.0:1790919418.781090:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919418.781114:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978141184:0@lo:400: 00000100:00100000:0.0:1790919418.782637:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141440 00000100:00100000:0.0:1790919418.782648:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141440 00000100:00100000:0.0:1790919418.782685:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141952 00000100:00100000:0.0:1790919418.782688:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141952 00000100:00100000:0.0:1790919418.782720:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790919418.782729:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978141440:12345-0@lo:400: 00000100:00100000:0.0:1790919418.782800:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978141440:12345-0@lo:400: Request processed in 72us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919418.782807:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790919418.782826:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919418.782833:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978141952:12345-0@lo:400: 00000100:00100000:0.0:1790919418.782864:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978141952:12345-0@lo:400: Request processed in 32us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919418.782884:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919418.782927:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978142080:0@lo:13: 00000100:00100000:0.0:1790919418.783274:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919418.785210:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978142080 00000100:00100000:0.0:1790919418.785223:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978142080 00000100:00100000:0.0:1790919418.785273:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919418.785291:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978142080:12345-0@lo:13: 00002000:00000024:0.0:1790919418.785325:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919418.785393:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978142080:12345-0@lo:13: Request processed in 112us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919418.785400:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790919418.785442:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658fb80 x1877914978142080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919418.785461:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978142080:0@lo:13: 00000100:00100000:3.0:1790919418.785974:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978140800:0@lo:400: 00000100:00100000:3.0:1790919418.786019:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.786043:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978141312:0@lo:400: 00000100:00100000:3.0:1790919418.786086:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.786104:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978141824:0@lo:400: 00000100:00100000:3.0:1790919418.786123:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.786138:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919418.786143:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978142208:0@lo:13: 00000100:00100000:3.0:1790919418.786161:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919418.786187:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140416 00000100:00100000:3.0:1790919418.786191:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140416 00000100:00100000:3.0:1790919418.786227:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790919418.786233:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141312 00000100:00100000:3.0:1790919418.786235:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978140416:12345-0@lo:400: 00000100:00100000:0.0:1790919418.786239:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141312 00000100:00100000:0.0:1790919418.786269:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141824 00000100:00100000:0.0:1790919418.786272:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141824 00000100:00100000:3.0:1790919418.786276:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978140416:12345-0@lo:400: Request processed in 41us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.786295:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790919418.786306:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919418.786317:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978141312:12345-0@lo:400: 00000100:00100000:1.0:1790919418.786415:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978142208 00000100:00100000:1.0:1790919418.786420:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978142208 00000100:00100000:1.0:1790919418.786446:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919418.786453:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978142208:12345-0@lo:13: 00000100:00100000:0.0:1790919418.786494:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978141312:12345-0@lo:400: Request processed in 180us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919418.786500:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919418.786517:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919418.786523:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978141824:12345-0@lo:400: 00000100:00100000:0.0:1790919418.786564:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978141824:12345-0@lo:400: Request processed in 41us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919418.786643:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919418.786849:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140544 00000100:00100000:3.0:1790919418.786854:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140544 00002000:00000024:1.0:1790919418.786858:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919418.786871:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141056 00000100:00100000:3.0:1790919418.786877:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141568 00000100:00100000:2.0:1790919418.786878:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141056 00000100:00100000:3.0:1790919418.786883:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141568 00000100:00100000:1.0:1790919418.786901:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978142208:12345-0@lo:13: Request processed in 448us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.786904:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790919418.786914:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790919418.786916:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978140928:12345-0@lo:400: 00000100:00100000:1.0:1790919418.786951:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919418.786964:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978140928:12345-0@lo:400: Request processed in 49us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.786971:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919418.786986:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919418.786993:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978141568:12345-0@lo:400: 00000100:00100000:3.0:1790919418.787022:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978141568:12345-0@lo:400: Request processed in 29us (6093us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.787027:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919418.787070:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140672 00000100:00100000:3.0:1790919418.787074:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140672 00000100:00100000:3.0:1790919418.787099:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978140800 00000100:00100000:3.0:1790919418.787101:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978140800 00000100:00100000:3.0:1790919418.787114:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919418.787120:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978140672:12345-0@lo:400: 00000100:00100000:3.0:1790919418.787153:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978140672:12345-0@lo:400: Request processed in 34us (6065us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.787158:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919418.787168:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790919418.787174:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978140800:12345-0@lo:400: 00000100:00100000:3.0:1790919418.787199:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978140800:12345-0@lo:400: Request processed in 26us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.787205:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919418.787213:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978140544:12345-0@lo:400: 00010000:00080000:3.0:1790919418.787242:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658e680 x1877914978142208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919418.787260:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978142208:0@lo:13: 00000100:00100000:1.0:1790919418.787275:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978140544:12345-0@lo:400: Request processed in 314us (6652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.787288:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978140800:0@lo:400: 00000100:00100000:1.0:1790919418.787295:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1790919418.787318:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebe300 x1877914978141312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919418.787328:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978141312:0@lo:400: 00010000:00080000:3.0:1790919418.787337:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58be300 x1877914978141824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919418.787345:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978141824:0@lo:400: 00000100:00080000:2.0:1790919418.787734:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919418.787739:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919418.787753:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919418.787796:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978141696:0@lo:400: 00000100:00100000:2.0:1790919418.787831:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919418.787848:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141184 00000100:00100000:1.0:1790919418.787855:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141184 00000100:00100000:2.0:1790919418.787870:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978140672:0@lo:400: 00000100:00100000:1.0:1790919418.787894:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978141696 00000100:00100000:1.0:1790919418.787898:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978141696 00000100:00100000:2.0:1790919418.787900:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919418.787911:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978141184:12345-0@lo:400: 00000100:00100000:1.0:1790919418.787920:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790919418.787930:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978141696:12345-0@lo:400: 00000100:00100000:2.0:1790919418.787957:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978141184:12345-0@lo:400: Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919418.787965:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919418.788154:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978141696:12345-0@lo:400: Request processed in 224us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919418.788161:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790919418.790999:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978141568:0@lo:400: 00000100:00100000:3.0:1790919418.791016:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978140416:0@lo:400: 00000100:00100000:3.0:1790919418.791028:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978140928:0@lo:400: 00010000:00080000:3.0:1790919418.791041:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebc700 x1877914978141440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919418.791077:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978141440:0@lo:400: 00010000:00080000:3.0:1790919418.791091:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bea00 x1877914978141952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919418.791099:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978141952:0@lo:400: 00000100:00100000:3.0:1790919418.791135:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978140544:0@lo:400: 00000100:00100000:3.0:1790919418.792368:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790919418.792380:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978141056:12345-0@lo:400: 00000100:00100000:3.0:1790919418.792466:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978141056:12345-0@lo:400: Request processed in 89us (11582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919418.792475:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790919418.792515:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978141056:0@lo:400: 00000100:00080000:3.0:1790919418.794110:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919418.794119:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790919418.794860:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebd500 x1877914978141184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919418.794877:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978141184:0@lo:400: 00010000:00080000:2.0:1790919418.794895:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bd180 x1877914978141696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919418.794905:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978141696:0@lo:400: 00010000:00010000:0.0:1790919419.295951:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919420.317528:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790919420.769815:0:9852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc63038ac0 20000000:00000080:0.0:1790919420.769832:0:9852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f284bcac00 uarg=0000000000000000 20000000:01000000:0.0:1790919420.769866:0:9852:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790919420.769868:0:9852:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790919420.769871:0:9852:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790919420.769876:0:9852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790919420.769880:0:9852:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790919420.769893:0:9852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790919420.769896:0:9852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790919420.770260:0:9852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790919420.770273:0:9852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790919420.771101:0:9853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1790919420.772491:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1790919420.772548:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1790919420.772606:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1790919420.772723:0:9852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790919420.772726:0:9852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790919420.773760:0:9854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1790919420.774253:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1790919420.774331:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1790919420.774385:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1790919420.774401:0:9852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790919420.774404:0:9852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790919420.775318:0:9855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1790919420.775863:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1790919420.775913:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1790919420.776045:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1790919420.776176:0:9852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790919420.776178:0:9852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790919420.777636:0:9856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1790919420.778141:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1790919420.778202:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1790919420.778239:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1790919420.778252:0:9852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790919420.778254:0:9852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790919420.779092:0:9857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1790919420.779463:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1790919420.779509:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1790919420.779703:0:9852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:0.0:1790919420.779721:0:9852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790919420.779740:0:9852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779759:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159134a0 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779766:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159134ca expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779773:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913509 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779779:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913517 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779786:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913525 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779793:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913541 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779799:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591356b expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779806:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913587 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779812:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159135b1 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779834:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 9 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779842:0:9852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 9 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779849:0:9852:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779882:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 9 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.779896:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 9 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.779909:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142336:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919420.780087:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 9 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780096:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 9 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780104:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142464:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919420.780141:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159135b1 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780149:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159135b1 expref: 23 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780172:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142592:0@lo:104: 00000100:00100000:0.0:1790919420.780213:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919420.780244:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913587 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780252:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913587 expref: 23 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780260:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142720:0@lo:104: 00000100:00100000:0.0:1790919420.780293:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919420.780329:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591356b expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780338:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591356b expref: 23 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780347:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142848:0@lo:104: 00000100:00100000:0.0:1790919420.780369:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919420.780387:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913541 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780396:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913541 expref: 23 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780404:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142976:0@lo:104: 00000100:00100000:0.0:1790919420.780427:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919420.780430:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978142592 00000100:00100000:3.0:1790919420.780437:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978142592 00010000:00010000:0.0:1790919420.780444:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913525 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780461:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913525 expref: 23 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780469:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143104:0@lo:104: 00000100:00100000:3.0:1790919420.780478:0:6428:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790919420.780494:0:6428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919420.780494:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913517 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780502:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913517 expref: 23 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.780503:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978142720 00000100:00100000:3.0:1790919420.780506:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978142720 00000100:00100000:0.0:1790919420.780510:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143232:0@lo:104: 00000100:00100000:3.0:1790919420.780518:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978142848 00000100:00100000:3.0:1790919420.780521:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978142848 00000100:00100000:3.0:1790919420.780529:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978142976 00000100:00100000:0.0:1790919420.780529:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919420.780531:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978142976 00000100:00100000:3.0:1790919420.780539:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143104 00000100:00100000:3.0:1790919420.780541:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143104 00000100:00100000:3.0:1790919420.780550:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143232 00000100:00100000:3.0:1790919420.780552:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143232 00000100:00100000:3.0:1790919420.780564:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919420.780571:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+8:9852:x1877914978142592:12345-0@lo:104: 00010000:00010000:3.0:1790919420.780583:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.780646:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919420.780653:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+8:9852:x1877914978142592:12345-0@lo:104: Request processed in 82us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919420.780661:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919420.780681:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790919420.780688:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+7:9852:x1877914978142720:12345-0@lo:104: 00010000:00010000:3.0:1790919420.780702:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.780749:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919420.780755:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+7:9852:x1877914978142720:12345-0@lo:104: Request processed in 69us (463us total) trans 0 rc 0/0 00010000:00010000:1.0:1790919420.780759:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1790919420.780763:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1790919420.780769:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.780779:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b600 already unused, calling callback (ffffffffc1a99c20) 00000100:00100000:3.0:1790919420.780780:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 10000000:00010000:1.0:1790919420.780786:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.780792:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9852:x1877914978142848:12345-0@lo:104: 00010000:00010000:1.0:1790919420.780804:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.780805:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780805:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913509 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919420.780826:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780827:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913509 expref: 23 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919420.780843:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1790919420.780848:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143360:0@lo:104: 00010000:00010000:1.0:1790919420.780879:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.780889:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919420.780891:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919420.780914:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.780918:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159134ca expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.780920:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1790919420.780925:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad159135b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159135b8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.780927:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9852:x1877914978142848:12345-0@lo:104: Request processed in 139us (557us total) trans 0 rc 0/0 00010000:00010000:0.0:1790919420.780930:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159134ca expref: 23 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.780949:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919420.780949:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143616:0@lo:104: 00010000:00010000:1.0:1790919420.780954:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919420.780959:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.780962:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143360 00000100:00100000:3.0:1790919420.780967:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143360 00000100:00100000:0.0:1790919420.780975:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919420.780980:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6487400 already unused, calling callback (ffffffffc1a99c20) 00000100:00100000:3.0:1790919420.780985:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919420.780991:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9852:x1877914978142976:12345-0@lo:104: 10000000:00010000:1.0:1790919420.780995:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.780999:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781007:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919420.781016:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919420.781022:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919420.781038:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1790919420.781042:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.781043:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919420.781044:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9852:x1877914978142976:12345-0@lo:104: Request processed in 53us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919420.781075:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978143488:0@lo:103: 00010000:00010000:1.0:1790919420.781077:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790919420.781099:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1790919420.781099:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781109:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591358e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.781111:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919420.781125:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919420.781129:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781134:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143616 00010000:00010000:1.0:1790919420.781137:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015a00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919420.781140:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781146:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143616 00010000:00010000:1.0:1790919420.781163:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781167:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 10000000:00010000:1.0:1790919420.781176:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781177:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9852:x1877914978143104:12345-0@lo:104: 10000000:01000000:1.0:1790919420.781188:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919420.781190:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781211:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781219:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919420.781224:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919420.781230:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9852:x1877914978143104:12345-0@lo:104: Request processed in 56us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919420.781235:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790919420.781255:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919420.781261:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:9852:x1877914978143232:12345-0@lo:104: 00010000:00010000:3.0:1790919420.781277:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781302:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790919420.781307:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:9852:x1877914978143232:12345-0@lo:104: Request processed in 48us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919420.781312:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919420.781323:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919420.781330:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:9852:x1877914978143360:12345-0@lo:104: 00010000:00010000:3.0:1790919420.781336:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781360:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790919420.781366:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:9852:x1877914978143360:12345-0@lo:104: Request processed in 38us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919420.781372:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1790919420.781379:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781488:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1790919420.781497:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad1591356b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913572 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781502:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:9852:x1877914978143616:12345-0@lo:104: 00010000:00010000:1.0:1790919420.781515:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790919420.781516:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781530:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781537:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6486200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919420.781541:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781547:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1790919420.781548:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781557:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:9852:x1877914978143616:12345-0@lo:104: Request processed in 58us (583us total) trans 0 rc 0/0 10000000:00010000:1.0:1790919420.781560:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.781565:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 10000000:01000000:1.0:1790919420.781574:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919420.781585:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790919420.781589:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781592:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781606:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919420.781608:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919420.781613:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781614:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781630:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781631:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6486200/0x951c50ad15913541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913548 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919420.781649:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781652:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790919420.781659:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919420.781660:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919420.781671:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6487200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919420.781674:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781681:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781682:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781697:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1790919420.781699:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.781706:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919420.781707:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919420.781724:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781730:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919420.781741:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781747:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6487200/0x951c50ad15913517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591351e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781756:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919420.781759:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781764:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919420.781766:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781772:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919420.781777:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919420.781782:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919420.781795:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781801:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919420.781804:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781810:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad15913509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913510 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781818:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919420.781826:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781832:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919420.781835:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781841:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919420.781847:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919420.781852:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919420.781865:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781871:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919420.781875:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781880:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159134ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134d1 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.781889:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919420.781891:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919420.781892:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919420.781905:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978143872:0@lo:103: 00000100:00100000:1.0:1790919420.781950:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.781974:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978144384:0@lo:103: 00000100:00100000:1.0:1790919420.782006:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.782024:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790919420.782030:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978143744:0@lo:103: 00000100:00100000:1.0:1790919420.782069:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.782086:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978144256:0@lo:103: 00000100:00100000:1.0:1790919420.782106:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.782132:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143872 00000100:00100000:1.0:1790919420.782136:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143872 00010000:00010000:1.0:1790919420.782155:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591356b expref: 24 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919420.782169:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144384 00000100:00100000:1.0:1790919420.782171:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144384 00010000:00010000:1.0:1790919420.782181:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913509 expref: 25 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919420.782189:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143744 00000100:00100000:1.0:1790919420.782191:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143744 00010000:00010000:1.0:1790919420.782198:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913587 expref: 26 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919420.782206:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144256 00000100:00100000:1.0:1790919420.782208:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144256 00010000:00010000:1.0:1790919420.782215:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913517 expref: 27 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782526:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978144000:0@lo:103: 00000100:00100000:1.0:1790919420.782622:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978143488 00000100:00100000:1.0:1790919420.782627:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978143488 00010000:00010000:1.0:1790919420.782644:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159135b1 expref: 28 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782664:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.782672:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144000 00000100:00100000:1.0:1790919420.782677:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144000 00000100:00100000:2.0:1790919420.782680:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978144512:0@lo:103: 00010000:00010000:1.0:1790919420.782693:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913541 expref: 29 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782704:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.782708:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144512 00000100:00100000:1.0:1790919420.782712:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144512 00000100:00100000:2.0:1790919420.782719:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1790919420.782726:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159134ca expref: 30 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782728:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978144128:0@lo:103: 00000100:00100000:1.0:1790919420.782749:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919420.782758:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+30:3461:x1877914978143872:12345-0@lo:103: 00000100:00100000:2.0:1790919420.782761:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919420.782773:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919420.782780:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591356b expref: 30 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782787:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144128 00010000:00010000:1.0:1790919420.782790:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591356b expref: 30 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782793:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144128 00010000:00010000:1.0:1790919420.782810:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919420.782813:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913525 expref: 31 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782834:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919420.782842:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+31:3461:x1877914978144384:12345-0@lo:103: 00010000:00010000:2.0:1790919420.782851:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790919420.782852:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+31:3461:x1877914978143872:12345-0@lo:103: Request processed in 94us (899us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919420.782858:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913509 expref: 31 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919420.782865:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1790919420.782874:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913509 expref: 31 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.782887:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919420.782887:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919420.782896:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+30:3461:x1877914978143744:12345-0@lo:103: 00010000:00010000:1.0:1790919420.782906:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919420.782912:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913587 expref: 30 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.782919:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+30:3461:x1877914978144384:12345-0@lo:103: Request processed in 76us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919420.782928:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919420.782949:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919420.782955:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+29:3461:x1877914978144256:12345-0@lo:103: 00010000:00010000:2.0:1790919420.782963:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919420.782982:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913517 expref: 29 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.783000:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913587 expref: 29 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.783471:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913517 expref: 29 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.783488:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919420.783495:0:9852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159134a0 expref: 29 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.783508:0:9852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159134a0 expref: 29 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.783592:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919420.783806:0:9852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978144640:0@lo:104: 00000100:00100000:1.0:1790919420.783807:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+29:3461:x1877914978143744:12345-0@lo:103: Request processed in 625us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919420.783819:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919420.783842:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919420.783847:0:9852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919420.783852:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+28:3458:x1877914978143488:12345-0@lo:103: 00010000:00010000:1.0:1790919420.783863:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919420.783868:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159135b1 expref: 28 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.783878:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159135b1 expref: 28 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.783888:0:9852:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1790919420.783889:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919420.783914:0:9852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204b800/0x951c50ad159135b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159135b1 expref: 28 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.783928:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142592:0@lo:104: 00010000:00010000:0.0:1790919420.783942:0:9852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6486600/0x951c50ad1591358e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913587 expref: 27 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.783950:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142720:0@lo:104: 00010000:00010000:0.0:1790919420.783959:0:9852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204a200/0x951c50ad15913572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591356b expref: 26 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.783967:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142848:0@lo:104: 00000100:00100000:0.0:1790919420.783976:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142976:0@lo:104: 00000100:00100000:0.0:1790919420.783983:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143104:0@lo:104: 00010000:00010000:0.0:1790919420.783991:0:9852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015000/0x951c50ad1591351e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913517 expref: 25 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.784000:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143232:0@lo:104: 00000100:00100000:1.0:1790919420.784008:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978143488:12345-0@lo:103: Request processed in 82us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919420.784019:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1790919420.784028:0:9852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2dc00/0x951c50ad15913510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913509 expref: 24 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.784074:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143360:0@lo:104: 00000100:00100000:0.0:1790919420.784089:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978143616:0@lo:104: 00000100:00100000:2.0:1790919420.784203:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3461:x1877914978144256:12345-0@lo:103: Request processed in 669us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919420.784211:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919420.784333:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919420.784343:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3458:x1877914978144000:12345-0@lo:103: 00010000:00010000:1.0:1790919420.784352:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790919420.784354:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1790919420.784359:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913541 expref: 21 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.784367:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3458:x1877914978144512:12345-0@lo:103: 00010000:00010000:1.0:1790919420.784373:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913541 expref: 21 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.784379:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919420.784387:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159134ca expref: 21 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.784488:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15913525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591352c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.784499:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919420.784502:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919420.784503:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919420.784516:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919420.784529:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144640 00000100:00100000:3.0:1790919420.784535:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144640 00000100:00100000:3.0:1790919420.784564:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790919420.784571:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:9852:x1877914978144640:12345-0@lo:104: 00010000:00010000:3.0:1790919420.784581:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.784636:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919420.784642:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:9852:x1877914978144640:12345-0@lo:104: Request processed in 72us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919420.784648:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1790919420.784663:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790919420.784666:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1790919420.784668:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.784675:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014c00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919420.784678:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.784686:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919420.784702:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919420.784707:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919420.784729:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.784730:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1790919420.784735:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919420.784746:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919420.784752:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad159134a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134a7 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919420.784756:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142336:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919420.784763:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978142464:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919420.784766:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919420.784767:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919420.784769:0:9852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9852:1877914978144640:0@lo:104: 00010000:00010000:2.0:1790919420.784947:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159134ca expref: 21 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.784959:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c000/0x951c50ad159134d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159134ca expref: 21 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.784968:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919420.784996:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3458:x1877914978144512:12345-0@lo:103: Request processed in 633us (2293us total) trans 0 rc 0/0 00010000:00010000:1.0:1790919420.785004:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014a00/0x951c50ad15913548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913541 expref: 20 pid: 6438 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.785015:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919420.785044:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3458:x1877914978144000:12345-0@lo:103: Request processed in 703us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919420.785071:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919420.785086:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958172928 00000100:00100000:1.0:1790919420.785090:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958172928 00010000:00010000:1.0:1790919420.785105:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 10 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919420.785119:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173056 00000100:00100000:1.0:1790919420.785122:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173056 00010000:00010000:3.0:1790919420.785130:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919420.785134:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 11 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.785145:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978144768:0@lo:103: 00000100:00100000:1.0:1790919420.785151:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919420.785160:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:3458:x1877914978144128:12345-0@lo:103: 00010000:00010000:1.0:1790919420.785169:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919420.785174:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913525 expref: 18 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919420.785184:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919420.785184:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913525 expref: 18 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.785200:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2d600/0x951c50ad1591352c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913525 expref: 18 pid: 6439 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.785294:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919420.785305:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790919420.785325:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3458:x1877914978144128:12345-0@lo:103: Request processed in 165us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919420.785330:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144768 00000100:00100000:1.0:1790919420.785334:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919420.785336:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144768 00010000:00010000:2.0:1790919420.785354:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159134a0 expref: 16 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.785374:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1790919420.785381:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1790919420.785383:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+11:2414:x1877914958172928:12345-192.168.203.11@tcp:103: 00010000:00010000:2.0:1790919420.785392:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919420.785397:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 11 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785405:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 11 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785416:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204b000/0x951c50ad159135cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38aa3 expref: 11 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785425:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919420.785463:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8157f22-2e62-481b-a08b-6545627fb184+10:2414:x1877914958173056:12345-192.168.203.11@tcp:103: 00000100:00100000:2.0:1790919420.785468:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+10:2414:x1877914958172928:12345-192.168.203.11@tcp:103: Request processed in 85us (800us total) trans 0 rc 0/0 00010000:00010000:1.0:1790919420.785475:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790919420.785478:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00010000:00010000:1.0:1790919420.785484:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 10 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.785498:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1790919420.785500:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 9 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919420.785509:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:3459:x1877914978144768:12345-0@lo:103: 00010000:00010000:1.0:1790919420.785516:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204be00/0x951c50ad159135c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38a9c expref: 9 pid: 6440 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785518:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919420.785524:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159134a0 expref: 16 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919420.785597:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919420.785620:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a8157f22-2e62-481b-a08b-6545627fb184+8:2414:x1877914958173056:12345-192.168.203.11@tcp:103: Request processed in 160us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919420.785626:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1790919420.785658:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978143744:0@lo:103: 00000100:00100000:1.0:1790919420.785669:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978144256:0@lo:103: 00010000:00010000:0.0:1790919420.785678:0:9852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919420.785686:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978143872:0@lo:103: 00000100:00100000:1.0:1790919420.785701:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978144384:0@lo:103: 00010000:00010000:2.0:1790919420.785744:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159134a0 expref: 16 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785769:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159134a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159134a0 expref: 16 pid: 6440 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785782:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785788:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785801:0:6430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785807:0:6430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785813:0:6430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785819:0:6430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785824:0:6430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919420.785828:0:6430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.785834:0:6430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.786476:0:9852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919420.786486:0:9852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.787655:0:6430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.787681:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015600/0x951c50ad1591360c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919420.787699:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919420.787777:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:3459:x1877914978144768:12345-0@lo:103: Request processed in 2269us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919420.787786:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919420.787880:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978144768:0@lo:103: 00000100:00100000:2.0:1790919420.787930:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978144128:0@lo:103: 00000100:00100000:2.0:1790919420.787940:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978144000:0@lo:103: 00000100:00100000:2.0:1790919420.787948:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978144512:0@lo:103: 00000100:00100000:2.0:1790919420.787956:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978143488:0@lo:103: 00010000:00010000:3.0:1790919421.341818:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919421.852358:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919421.852411:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978144896:0@lo:41: 00000100:00100000:1.0:1790919421.852491:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919421.853111:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978145024:0@lo:41: 00000100:00100000:1.0:1790919421.853188:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919421.853235:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978144896 00000100:00100000:0.0:1790919421.853246:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978144896 00000100:00100000:2.0:1790919421.853325:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145024 00000100:00100000:2.0:1790919421.853331:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145024 00000100:00100000:0.0:1790919421.853332:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919421.853346:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978144896:12345-0@lo:41: 00000100:00100000:2.0:1790919421.853364:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790919421.853374:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978145024:12345-0@lo:41: 00000004:00000024:0.0:1790919421.853399:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000004:00000024:2.0:1790919421.853402:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919421.853520:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978145024:12345-0@lo:41: Request processed in 146us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919421.853528:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919421.853628:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978145024:0@lo:41: 00000100:00100000:0.0:1790919421.855111:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978144896:12345-0@lo:41: Request processed in 1760us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919421.855153:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978144896:0@lo:41: 00000100:00100000:0.0:1790919421.856351:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 10000000:01000000:2.0:1790919422.046645:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790919422.046654:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3a6ada000 from 48 10000000:01000000:2.0:1790919422.046660:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790919422.046710:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.046722:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.046751:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919422.046774:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145152:0@lo:101: 00000100:00100000:2.0:1790919422.046978:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.047177:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae8546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.047245:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145152 00000100:00100000:0.0:1790919422.047253:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145152 00000100:00100000:0.0:1790919422.047322:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790919422.047332:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+15:6443:x1877914978145152:12345-0@lo:101: 00010000:00010000:0.0:1790919422.047346:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919422.047361:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014200/0x951c50ad1591361a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913613 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.047383:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014200/0x951c50ad1591361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913613 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.047395:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014200/0x951c50ad1591361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913613 expref: 16 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.047403:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014200, rc 0) 00000100:00100000:0.0:1790919422.047462:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978145152:12345-0@lo:101: Request processed in 132us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.047469:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790919422.047584:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145152:0@lo:101: 00010000:00010000:2.0:1790919422.047598:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.047607:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919422.047658:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145280:0@lo:501: 00000100:00100000:2.0:1790919422.047685:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.047709:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae8546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.047769:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145280 00000100:00100000:3.0:1790919422.047774:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145280 00000100:00100000:3.0:1790919422.047819:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1790919422.047827:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978145280:12345-0@lo:501: 00000100:00100000:3.0:1790919422.048123:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978145280:12345-0@lo:501: Request processed in 295us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.048129:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790919422.048313:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145280:0@lo:501: 00000100:00100000:1.0:1790919422.048344:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145408:0@lo:503: 00000100:00100000:1.0:1790919422.048376:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919422.048398:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.048565:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145408 00000100:00100000:0.0:1790919422.048569:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145408 00000100:00100000:0.0:1790919422.048660:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790919422.048668:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978145408:12345-0@lo:503: 00000100:00100000:0.0:1790919422.048832:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978145408:12345-0@lo:503: Request processed in 164us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.048839:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790919422.048903:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145408:0@lo:503: 00000100:00100000:1.0:1790919422.049162:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9869:1877914978145536:0@lo:502: 00000100:00100000:1.0:1790919422.049198:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919422.049632:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.049670:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145536 00000100:00100000:2.0:1790919422.049675:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145536 00000100:00100000:2.0:1790919422.049700:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790919422.049706:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9869:x1877914978145536:12345-0@lo:502: 00000100:00100000:2.0:1790919422.050299:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9869:x1877914978145536:12345-0@lo:502: Request processed in 591us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.050307:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790919422.051745:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9869:1877914978145536:0@lo:502: 00000100:00100000:1.0:1790919422.051874:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9869:1877914978145664:0@lo:502: 00000100:00100000:1.0:1790919422.051931:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919422.052019:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f0e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.052212:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145664 00000100:00100000:3.0:1790919422.052227:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145664 00000100:00100000:3.0:1790919422.052334:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1790919422.052345:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9869:x1877914978145664:12345-0@lo:502: 00000100:00100000:3.0:1790919422.052620:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:9869:x1877914978145664:12345-0@lo:502: Request processed in 277us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.052628:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790919422.052704:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9869:1877914978145664:0@lo:502: 00000040:00080000:1.0:1790919422.052726:0:9869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790919422.052966:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790919422.052985:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790919422.053003:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.053027:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919422.053036:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790919422.053039:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790919422.053042:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790919422.053207:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.053217:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.053225:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919422.053241:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145792:0@lo:101: 00000100:00100000:0.0:1790919422.053287:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.053523:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.053578:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145792 00000100:00100000:2.0:1790919422.053584:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145792 00000100:00100000:2.0:1790919422.053612:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1790919422.053620:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+16:6443:x1877914978145792:12345-0@lo:101: 00010000:00010000:2.0:1790919422.053638:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919422.053651:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204be00/0x951c50ad15913628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913621 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.053672:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204be00/0x951c50ad15913628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913621 expref: 17 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.053681:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204be00/0x951c50ad15913628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913621 expref: 17 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.053688:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204be00, rc 0) 00000100:00100000:2.0:1790919422.053728:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978145792:12345-0@lo:101: Request processed in 109us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.053734:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790919422.053915:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145792:0@lo:101: 00010000:00010000:0.0:1790919422.053928:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.053938:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919422.053985:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145920:0@lo:501: 00000100:00100000:0.0:1790919422.054022:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.054070:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.054163:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978145920 00000100:00100000:2.0:1790919422.054168:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978145920 00000100:00100000:2.0:1790919422.054188:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1790919422.054194:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978145920:12345-0@lo:501: 00000100:00100000:2.0:1790919422.054446:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978145920:12345-0@lo:501: Request processed in 251us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.054453:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790919422.054572:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978145920:0@lo:501: 00000100:00100000:0.0:1790919422.054600:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146048:0@lo:503: 00000100:00100000:0.0:1790919422.054638:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.054667:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.054721:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146048 00000100:00100000:3.0:1790919422.054726:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146048 00000100:00100000:3.0:1790919422.054752:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790919422.054760:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978146048:12345-0@lo:503: 00000100:00100000:3.0:1790919422.054984:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978146048:12345-0@lo:503: Request processed in 225us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.054991:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790919422.055199:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146048:0@lo:503: 00000100:00100000:0.0:1790919422.056889:0:9870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9870:1877914978146176:0@lo:502: 00000100:00100000:0.0:1790919422.056965:0:9870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.057047:0:9870:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533000 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.057298:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146176 00000100:00100000:3.0:1790919422.057305:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146176 00000100:00100000:3.0:1790919422.057382:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1790919422.057392:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9870:x1877914978146176:12345-0@lo:502: 00000100:00100000:3.0:1790919422.057590:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9870:x1877914978146176:12345-0@lo:502: Request processed in 200us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.057597:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1790919422.057672:0:9870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9870:1877914978146176:0@lo:502: 00000020:01000000:0.0:1790919422.057699:0:9870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919422.057708:0:9870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919422.057710:0:9870:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790919422.057715:0:9870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790919422.057735:0:9870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9870:1877914978146304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919422.057768:0:9870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.058197:0:9870:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533000 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.058310:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146304 00000100:00100000:2.0:1790919422.058315:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146304 00000100:00100000:2.0:1790919422.058341:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790919422.058348:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9870:x1877914978146304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.058488:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:9870:x1877914978146304:12345-0@lo:502:llog_process_th.0 Request processed in 140us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.058496:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790919422.058604:0:9870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9870:1877914978146304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919422.058626:0:9870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919422.058631:0:9870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919422.058633:0:9870:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790919422.058637:0:9870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1790919422.058865:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1790919422.058889:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790919422.058899:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.058909:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919422.058918:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790919422.058921:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3be491000 from 48 10000000:01000000:2.0:1790919422.058923:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790919422.058946:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.058953:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.058961:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919422.058976:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.059019:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.059041:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.059168:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146432 00000100:00100000:0.0:1790919422.059173:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146432 00000100:00100000:0.0:1790919422.059192:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790919422.059199:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+17:6443:x1877914978146432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919422.059217:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919422.059229:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014000/0x951c50ad15913636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591362f expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.059250:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014000/0x951c50ad15913636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591362f expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.059270:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014000/0x951c50ad15913636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591362f expref: 18 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.059280:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014000, rc 0) 00000100:00100000:0.0:1790919422.059339:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978146432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.059345:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790919422.059476:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919422.059488:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.059496:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919422.059547:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.059571:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.059597:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.059640:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146560 00000100:00100000:0.0:1790919422.059644:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146560 00000100:00100000:0.0:1790919422.059671:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790919422.059678:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978146560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.059970:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978146560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.059977:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790919422.061620:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.061673:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.061750:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.061830:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.062044:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146688 00000100:00100000:1.0:1790919422.062067:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146688 00000100:00100000:0.0:1790919422.062246:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790919422.062266:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978146688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.062456:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978146688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.062465:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1790919422.062556:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978146688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.063147:0:9871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9871:1877914978146816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.063193:0:9871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.063225:0:9871:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.063287:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146816 00000100:00100000:3.0:1790919422.063293:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146816 00000100:00100000:3.0:1790919422.063334:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790919422.063343:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9871:x1877914978146816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.063562:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9871:x1877914978146816:12345-0@lo:502:llog_process_th.0 Request processed in 220us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.063570:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1790919422.063890:0:9871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9871:1877914978146816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.063935:0:9871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9871:1877914978146944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.063968:0:9871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.063992:0:9871:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.064262:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978146944 00000100:00100000:3.0:1790919422.064268:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978146944 00000100:00100000:3.0:1790919422.064327:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790919422.064334:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9871:x1877914978146944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.064467:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:9871:x1877914978146944:12345-0@lo:502:llog_process_th.0 Request processed in 133us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.064473:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790919422.064587:0:9871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9871:1877914978146944:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790919422.064608:0:9871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790919422.064875:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790919422.064892:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790919422.064902:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.064914:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919422.064923:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790919422.064925:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790919422.064928:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790919422.064953:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.064960:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.064968:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919422.064983:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.065222:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.065295:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.065487:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147072 00000100:00100000:1.0:1790919422.065492:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147072 00000100:00100000:1.0:1790919422.065520:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1790919422.065527:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+18:6443:x1877914978147072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919422.065537:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919422.065549:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6487200/0x951c50ad15913644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591363d expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.065570:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6487200/0x951c50ad15913644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591363d expref: 19 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.065581:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6487200/0x951c50ad15913644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591363d expref: 19 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.065589:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487200, rc 0) 00000100:00100000:1.0:1790919422.065621:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978147072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919422.065628:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1790919422.065703:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919422.065717:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.065726:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919422.065896:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.065922:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.065948:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.065992:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147200 00000100:00100000:1.0:1790919422.066007:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147200 00000100:00100000:1.0:1790919422.066025:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1790919422.066031:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978147200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919422.066302:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978147200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919422.066309:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1790919422.066427:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.066453:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.066494:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.066522:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.066629:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147328 00000100:00100000:0.0:1790919422.066641:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147328 00000100:00100000:0.0:1790919422.066663:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790919422.066669:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978147328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.066941:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978147328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.066947:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1790919422.067162:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.067537:0:9872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9872:1877914978147456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.067578:0:9872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.067611:0:9872:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.067749:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147456 00000100:00100000:1.0:1790919422.067754:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147456 00000100:00100000:1.0:1790919422.067789:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1790919422.067936:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:9872:x1877914978147456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919422.068190:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:9872:x1877914978147456:12345-0@lo:502:llog_process_th.0 Request processed in 258us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919422.068204:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790919422.068333:0:9872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9872:1877914978147456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919422.068368:0:9872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919422.068378:0:9872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919422.068380:0:9872:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790919422.068385:0:9872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790919422.068406:0:9872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9872:1877914978147584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.068442:0:9872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.068471:0:9872:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.068522:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147584 00000100:00100000:3.0:1790919422.068527:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147584 00000100:00100000:3.0:1790919422.068562:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1790919422.068570:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:9872:x1877914978147584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.068709:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:9872:x1877914978147584:12345-0@lo:502:llog_process_th.0 Request processed in 139us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.068715:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790919422.069299:0:9872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9872:1877914978147584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919422.069324:0:9872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919422.069330:0:9872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919422.069332:0:9872:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790919422.069335:0:9872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1790919422.070614:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790919422.070648:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790919422.070659:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.070683:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919422.070694:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790919422.070696:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3b4712800 from 48 10000000:01000000:3.0:1790919422.070699:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919422.070730:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.070751:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.070761:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919422.070779:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.070986:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.071032:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.071135:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147712 00000100:00100000:1.0:1790919422.071142:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147712 00000100:00100000:1.0:1790919422.071186:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1790919422.071195:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:6443:x1877914978147712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919422.071208:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919422.071220:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6486200/0x951c50ad15913652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591364b expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.071241:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6486200/0x951c50ad15913652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591364b expref: 20 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.071251:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6486200/0x951c50ad15913652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591364b expref: 20 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.071268:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486200, rc 0) 00000100:00100000:1.0:1790919422.071307:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978147712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919422.071314:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1790919422.071419:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919422.071433:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.071441:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919422.071488:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.071512:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.071578:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35000 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.072312:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147840 00000100:00100000:2.0:1790919422.072319:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147840 00000100:00100000:2.0:1790919422.072390:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1790919422.072399:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978147840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.072667:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978147840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.072675:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790919422.072751:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.072789:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.072841:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.073354:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.073438:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978147968 00000100:00100000:1.0:1790919422.073444:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978147968 00000100:00100000:0.0:1790919422.073583:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790919422.073593:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978147968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.073893:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978147968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.073900:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790919422.073976:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978147968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.074381:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9873:1877914978148096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.074421:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.074599:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.074904:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148096 00000100:00100000:2.0:1790919422.074911:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148096 00000100:00100000:2.0:1790919422.074940:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790919422.074948:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9873:x1877914978148096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.075251:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9873:x1877914978148096:12345-0@lo:502:llog_process_th.0 Request processed in 303us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.075268:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790919422.075355:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9873:1877914978148096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.075398:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9873:1877914978148224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.075434:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.075460:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.075502:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148224 00000100:00100000:2.0:1790919422.075506:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148224 00000100:00100000:2.0:1790919422.075524:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790919422.075530:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9873:x1877914978148224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.075645:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:9873:x1877914978148224:12345-0@lo:502:llog_process_th.0 Request processed in 114us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.075662:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790919422.075733:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9873:1877914978148224:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790919422.075762:0:9873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790919422.076212:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1790919422.076244:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790919422.076253:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.076272:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919422.076282:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790919422.076285:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1790919422.076287:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790919422.076312:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.076320:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.076328:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919422.076341:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.076371:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.076384:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.076423:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148352 00000100:00100000:3.0:1790919422.076428:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148352 00000100:00100000:3.0:1790919422.076450:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790919422.076457:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978148352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919422.076466:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919422.076478:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2ca00/0x951c50ad15913660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913659 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.076499:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2ca00/0x951c50ad15913660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913659 expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.076522:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2ca00/0x951c50ad15913660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913659 expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.076530:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2ca00, rc 0) 00000100:00100000:3.0:1790919422.076569:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978148352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.076575:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790919422.076633:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919422.076644:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.076662:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919422.076707:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.076731:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.076786:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.076921:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148480 00000100:00100000:0.0:1790919422.076927:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148480 00000100:00100000:1.0:1790919422.077293:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790919422.077304:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978148480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919422.077560:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978148480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919422.077567:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1790919422.077629:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.077660:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.077703:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.079315:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.079452:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148608 00000100:00100000:3.0:1790919422.079460:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148608 00000100:00100000:3.0:1790919422.079505:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1790919422.079514:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978148608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.079722:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978148608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.079730:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790919422.079825:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.080343:0:9874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9874:1877914978148736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.080392:0:9874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.080419:0:9874:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece300 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.080459:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148736 00000100:00100000:3.0:1790919422.080464:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148736 00000100:00100000:3.0:1790919422.080488:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1790919422.080495:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9874:x1877914978148736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.080676:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9874:x1877914978148736:12345-0@lo:502:llog_process_th.0 Request processed in 180us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.080683:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790919422.080747:0:9874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9874:1877914978148736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919422.080769:0:9874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919422.080777:0:9874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919422.080780:0:9874:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790919422.080785:0:9874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790919422.080876:0:9874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9874:1877914978148864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.080909:0:9874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.080931:0:9874:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece300 going to sleep for 11 seconds 00000100:00100000:3.0:1790919422.080971:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148864 00000100:00100000:3.0:1790919422.080975:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148864 00000100:00100000:3.0:1790919422.080993:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790919422.081010:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9874:x1877914978148864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.081176:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9874:x1877914978148864:12345-0@lo:502:llog_process_th.0 Request processed in 166us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919422.081183:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790919422.081320:0:9874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9874:1877914978148864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919422.081346:0:9874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919422.081351:0:9874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919422.081353:0:9874:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790919422.081356:0:9874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1790919422.081483:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1790919422.081504:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790919422.081514:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.081525:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919422.081534:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790919422.081537:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f385571800 from 48 10000000:01000000:3.0:1790919422.081540:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919422.081563:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.081571:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.081580:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919422.081592:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.081620:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.081642:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.083159:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978148992 00000100:00100000:2.0:1790919422.083170:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978148992 00000100:00100000:2.0:1790919422.083208:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790919422.083216:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978148992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919422.083230:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919422.083247:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204b800/0x951c50ad1591366e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913667 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.083282:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204b800/0x951c50ad1591366e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913667 expref: 22 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.083293:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204b800/0x951c50ad1591366e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913667 expref: 22 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.083301:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204b800, rc 0) 00000100:00100000:2.0:1790919422.083362:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978148992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.083368:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790919422.083465:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978148992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919422.083481:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919422.083502:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919422.083562:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.083591:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.083617:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.083660:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149120 00000100:00100000:2.0:1790919422.083664:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149120 00000100:00100000:2.0:1790919422.083682:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790919422.083687:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978149120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.084005:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978149120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.084020:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790919422.084152:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.084179:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.084217:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.084240:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.084305:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149248 00000100:00100000:2.0:1790919422.084309:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149248 00000100:00100000:2.0:1790919422.084328:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790919422.084334:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978149248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919422.084471:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978149248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.084477:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790919422.084617:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.085337:0:9875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9875:1877914978149376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.085380:0:9875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.085400:0:9875:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.085685:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149376 00000100:00100000:2.0:1790919422.085691:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149376 00000100:00100000:2.0:1790919422.085737:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790919422.085744:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9875:x1877914978149376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.085982:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9875:x1877914978149376:12345-0@lo:502:llog_process_th.0 Request processed in 237us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.085990:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790919422.086157:0:9875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9875:1877914978149376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.086201:0:9875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9875:1877914978149504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.086238:0:9875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.086264:0:9875:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.086318:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149504 00000100:00100000:0.0:1790919422.086323:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149504 00000100:00100000:0.0:1790919422.086343:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790919422.086349:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9875:x1877914978149504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919422.086473:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9875:x1877914978149504:12345-0@lo:502:llog_process_th.0 Request processed in 123us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.086480:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790919422.086545:0:9875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9875:1877914978149504:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790919422.086563:0:9875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790919422.086752:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790919422.086772:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790919422.086781:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.086803:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919422.086824:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790919422.086827:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1790919422.086830:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790919422.086854:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.086862:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.086871:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919422.086884:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.086910:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.086935:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.087026:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149632 00000100:00100000:2.0:1790919422.087031:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149632 00000100:00100000:2.0:1790919422.087084:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1790919422.087092:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978149632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919422.087101:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919422.087112:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204bc00/0x951c50ad1591367c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913675 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.087137:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204bc00/0x951c50ad1591367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913675 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.087147:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204bc00/0x951c50ad1591367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913675 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919422.087162:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204bc00, rc 0) 00000100:00100000:2.0:1790919422.087196:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978149632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.087202:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790919422.087759:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919422.087774:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.087783:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919422.087909:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.087942:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.087979:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919422.088390:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149760 00000100:00100000:1.0:1790919422.088397:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149760 00000100:00100000:1.0:1790919422.088462:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790919422.088470:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978149760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919422.088718:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978149760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919422.088726:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790919422.088919:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.088951:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919422.089012:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.089650:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.089703:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978149888 00000100:00100000:0.0:1790919422.089708:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978149888 00000100:00100000:0.0:1790919422.089907:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790919422.089916:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978149888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.090220:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978149888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 305us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.090228:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790919422.090379:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978149888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919422.090667:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9876:1877914978150016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919422.090707:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919422.090943:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.090976:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150016 00000100:00100000:0.0:1790919422.090981:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150016 00000100:00100000:0.0:1790919422.091236:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790919422.091245:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9876:x1877914978150016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919422.091481:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9876:x1877914978150016:12345-0@lo:502:llog_process_th.0 Request processed in 236us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.091488:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790919422.091599:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9876:1877914978150016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919422.091624:0:9876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919422.091633:0:9876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919422.091635:0:9876:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790919422.091642:0:9876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790919422.091664:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9876:1877914978150144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919422.091699:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919422.091763:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919422.091960:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150144 00000100:00100000:2.0:1790919422.091965:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150144 00000100:00100000:2.0:1790919422.092039:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1790919422.092047:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9876:x1877914978150144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919422.092445:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9876:x1877914978150144:12345-0@lo:502:llog_process_th.0 Request processed in 399us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.092453:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790919422.092515:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9876:1877914978150144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919422.092536:0:9876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919422.092541:0:9876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919422.092543:0:9876:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790919422.092548:0:9876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1790919422.092687:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1790919422.092707:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790919422.092717:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.092729:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919422.092747:0:6443:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790919422.092750:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f3908ab380 from 1 10000000:01000000:1.0:1790919422.092753:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790919422.092778:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.092786:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.092815:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919422.092830:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978150272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919422.092869:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919422.095492:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.095584:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150272 00000100:00100000:0.0:1790919422.095593:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150272 00000100:00100000:0.0:1790919422.095650:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790919422.095659:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978150272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919422.095674:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919422.095691:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014400/0x951c50ad1591368a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913683 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.095718:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014400/0x951c50ad1591368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913683 expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.095728:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014400/0x951c50ad1591368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913683 expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919422.095737:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014400, rc 0) 00000100:00100000:0.0:1790919422.095822:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978150272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919422.095841:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790919422.096111:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978150272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919422.096127:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.096137:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919422.096199:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978150400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919422.096232:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919422.096248:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919422.096340:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150400 00000100:00100000:0.0:1790919422.096344:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150400 00000100:00100000:0.0:1790919422.096358:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790919422.096363:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978150400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919422.096576:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978150400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (343us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919422.096583:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790919422.096667:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978150400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790919422.096689:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790919422.096695:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919422.096703:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919422.364677:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978150528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919422.364741:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919422.364786:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919422.364793:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978150656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919422.364824:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919422.364904:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150528 00000100:00100000:2.0:1790919422.364913:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150528 00000100:00100000:2.0:1790919422.364966:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150656 00000100:00100000:2.0:1790919422.364969:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150656 00000100:00100000:2.0:1790919422.364988:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919422.364996:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978150528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790919422.365031:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919422.365105:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978150528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.365112:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919422.365128:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919422.365134:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978150656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919422.365142:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919422.365165:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978150656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919422.365184:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790919422.365217:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30000 x1877914978150656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919422.365235:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978150656:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790919422.365246:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c4380 x1877914978150528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919422.365266:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978150528:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790919422.365381:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790919422.365656:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919423.388517:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919423.436533:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919423.436643:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173184 00000100:00100000:0.0:1790919423.436654:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173184 00000100:00100000:0.0:1790919423.436715:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:0.0:1790919423.436725:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+8:2414:x1877914958173184:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1790919423.436800:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+8:2414:x1877914958173184:12345-192.168.203.11@tcp:400: Request processed in 76us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919423.436808:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:3.0:1790919423.436895:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919423.437119:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919423.437173:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919423.437223:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173568 00000100:00100000:0.0:1790919423.437228:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173568 00000100:00100000:0.0:1790919423.437283:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1790919423.437290:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958173568:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1790919423.437337:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958173568:12345-192.168.203.11@tcp:400: Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919423.437344:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00080000:0.0:1790919423.437363:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919423.437456:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919423.437893:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173312 00000100:00100000:2.0:1790919423.437899:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173312 00000100:00100000:2.0:1790919423.437991:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173440 00000100:00100000:2.0:1790919423.437996:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173440 00000100:00100000:0.0:1790919423.439084:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173696 00000100:00100000:0.0:1790919423.439092:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173696 00000100:00100000:3.0:1790919423.439256:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790919423.439274:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958173312:12345-192.168.203.11@tcp:400: 00000100:00100000:3.0:1790919423.439400:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958173312:12345-192.168.203.11@tcp:400: Request processed in 134us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919423.439409:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00080000:1.0:1790919423.440210:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919423.440216:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919423.440219:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919423.443179:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790919423.443196:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958173696:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1790919423.443292:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1790919423.443297:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958173696:12345-192.168.203.11@tcp:400: Request processed in 98us (5832us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919423.443308:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919423.443313:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958173440:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1790919423.443348:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958173440:12345-192.168.203.11@tcp:400: Request processed in 40us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919423.443355:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1790919423.900407:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919423.900470:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919423.900490:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978150912:0@lo:400:kworker.0 00000100:00100000:3.0:1790919423.900585:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919423.900634:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150912 00000100:00100000:3.0:1790919423.900640:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150912 00000100:00100000:3.0:1790919423.900701:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790919423.900710:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919423.900762:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978150912:12345-0@lo:400:kworker.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919423.900769:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790919423.900824:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978150912:0@lo:400:kworker.0 00000100:00100000:0.0:1790919423.902184:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919423.902200:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978151040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919423.902261:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919423.903118:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151040 00000100:00100000:0.0:1790919423.903128:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151040 00000100:00100000:0.0:1790919423.903179:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919423.903188:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978151040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919423.903218:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919423.903315:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978151040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919423.903322:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790919423.903369:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b6069c00 x1877914978151040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919423.903386:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978151040:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790919423.903432:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919423.907708:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919423.907732:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919423.907905:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919423.907969:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151168 00000100:00100000:3.0:1790919423.907977:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151168 00000100:00100000:3.0:1790919423.908028:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790919423.908038:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978151168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919423.908090:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919423.908130:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978151168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919423.908137:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1790919423.908161:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919423.908700:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bed80 x1877914978151168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919423.908718:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978151168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919423.908762:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978150784:0@lo:400:kworker.0 00000100:00100000:3.0:1790919423.908827:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919423.908952:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978150784 00000100:00100000:2.0:1790919423.909331:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978150784 00000100:00100000:2.0:1790919423.909671:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790919423.909686:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978150784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919423.909741:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978150784:12345-0@lo:400:kworker.0 Request processed in 61us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919423.909748:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790919423.912412:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978150784:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913250:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978151296:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913309:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.913356:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151296 00000100:00100000:1.0:1790919423.913371:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151296 00000100:00100000:1.0:1790919423.913413:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919423.913421:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978151296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913472:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978151296:12345-0@lo:400:kworker.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.913478:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919423.913512:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978151296:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913540:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919423.913546:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978151424:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913569:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.913593:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151424 00000100:00100000:1.0:1790919423.913596:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151424 00000100:00100000:1.0:1790919423.913617:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919423.913624:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978151424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913658:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978151424:12345-0@lo:400:kworker.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.913664:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919423.913700:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978151424:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913731:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978151552:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.913763:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.913791:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151552 00000100:00100000:1.0:1790919423.913961:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151552 00000100:00100000:1.0:1790919423.913990:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919423.913997:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978151552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914033:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978151552:12345-0@lo:400:kworker.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.914039:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919423.914086:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978151552:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914112:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919423.914118:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978151680:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914139:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.914162:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151680 00000100:00100000:1.0:1790919423.914166:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151680 00000100:00100000:1.0:1790919423.914263:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790919423.914269:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978151680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914432:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978151680:12345-0@lo:400:kworker.0 Request processed in 161us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.914439:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1790919423.914459:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919423.914478:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978151680:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914508:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978151808:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914531:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.914552:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151808 00000100:00100000:1.0:1790919423.914556:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151808 00000100:00100000:1.0:1790919423.914581:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919423.914594:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978151808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914627:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978151808:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.914633:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1790919423.914646:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790919423.914662:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5c00 x1877914978151808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919423.914673:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978151808:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914701:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919423.914706:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978151936:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.914730:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.914754:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978151936 00000100:00100000:1.0:1790919423.914758:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978151936 00000100:00100000:1.0:1790919423.914784:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919423.914789:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978151936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.915295:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978151936:12345-0@lo:400:kworker.0 Request processed in 504us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.915302:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1790919423.915332:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5c00 x1877914978151936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919423.915341:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978151936:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.918982:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978152064:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.919072:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.919141:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152064 00000100:00100000:1.0:1790919423.919149:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152064 00000100:00100000:1.0:1790919423.919220:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919423.919230:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978152064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.919302:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978152064:12345-0@lo:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.919309:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1790919423.919454:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5c00 x1877914978152064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919423.919468:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978152064:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.919519:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919423.919527:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978152192:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.919554:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.919579:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152192 00000100:00100000:1.0:1790919423.919583:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152192 00000100:00100000:1.0:1790919423.919631:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790919423.919640:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978152192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.919917:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978152192:12345-0@lo:400:kworker.0 Request processed in 278us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.919923:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1790919423.919942:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919423.919960:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978152192:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.920512:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978152320:0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.920543:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919423.920572:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152320 00000100:00100000:1.0:1790919423.920576:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152320 00000100:00100000:1.0:1790919423.920607:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790919423.920739:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978152320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919423.920849:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978152320:12345-0@lo:400:kworker.0 Request processed in 235us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919423.920857:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1790919423.920873:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790919423.920891:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5c00 x1877914978152320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919423.920903:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978152320:0@lo:400:kworker.0 00010000:00010000:3.0:1790919424.412926:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919425.437103:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919426.460316:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919426.972349:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919426.972349:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919426.972382:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978152576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919426.972383:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978152448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919426.974796:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919426.974844:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152448 00000100:00100000:0.0:1790919426.974857:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152448 00000100:00100000:0.0:1790919426.974942:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790919426.974954:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978152448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919426.975008:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919426.975089:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978152448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919426.975098:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790919426.975678:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978152448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919426.976086:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919426.976141:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152576 00000100:00100000:3.0:1790919426.976149:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152576 00000100:00100000:3.0:1790919426.976196:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919426.976206:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978152576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919426.976253:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919426.976304:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978152576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919426.976313:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919426.976427:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978152576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919427.018396:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919427.018474:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173824 00000100:00100000:2.0:1790919427.018488:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173824 00000100:00100000:2.0:1790919427.018571:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:2.0:1790919427.018584:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+8:6386:x1877914958173824:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1790919427.018607:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919427.018630:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204ba00/0x951c50ad15913691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b13 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919427.018667:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204ba00/0x951c50ad15913691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b13 expref: 9 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919427.018679:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204ba00/0x951c50ad15913691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b13 expref: 9 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919427.018689:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204ba00, rc 0) 00000100:00100000:2.0:1790919427.018772:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958173824:12345-192.168.203.11@tcp:101: Request processed in 191us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919427.018780:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:1.0:1790919427.028256:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919427.028357:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958173952 00000100:00100000:3.0:1790919427.028371:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958173952 00000100:00100000:3.0:1790919427.028449:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:3.0:1790919427.028461:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958173952:12345-192.168.203.11@tcp:501: 00000100:00100000:3.0:1790919427.028903:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958173952:12345-192.168.203.11@tcp:501: Request processed in 442us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919427.028913:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:0.0:1790919427.039171:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919427.040995:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174080 00000100:00100000:3.0:1790919427.041013:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174080 00000100:00100000:3.0:1790919427.041124:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:3.0:1790919427.041135:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958174080:12345-192.168.203.11@tcp:503: 00000100:00100000:3.0:1790919427.041446:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958174080:12345-192.168.203.11@tcp:503: Request processed in 312us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919427.041465:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:1.0:1790919427.052262:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919427.052568:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174208 00000100:00100000:2.0:1790919427.052582:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174208 00000100:00100000:2.0:1790919427.052652:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:2.0:1790919427.052663:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+9:6892:x1877914958174208:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1790919427.053012:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+9:6892:x1877914958174208:12345-192.168.203.11@tcp:502: Request processed in 349us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919427.053031:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:1.0:1790919427.061050:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919427.062322:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174336 00000100:00100000:0.0:1790919427.062405:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174336 00000100:00100000:0.0:1790919427.062495:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:0.0:1790919427.062509:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+9:6892:x1877914958174336:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919427.062857:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+9:6892:x1877914958174336:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 349us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919427.062867:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:0.0:1790919427.074771:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919427.075791:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174464 00000100:00100000:3.0:1790919427.075809:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174464 00000100:00100000:3.0:1790919427.076210:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1790919427.076235:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958174464:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919427.076260:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919427.076286:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c800/0x951c50ad15913698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b1a expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919427.076325:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c800/0x951c50ad15913698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b1a expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919427.076338:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c800/0x951c50ad15913698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b1a expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919427.077489:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c800, rc 0) 00000100:00100000:3.0:1790919427.077595:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958174464:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 1370us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919427.077605:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:1.0:1790919427.088014:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919427.088163:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174592 00000100:00100000:2.0:1790919427.088177:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174592 00000100:00100000:2.0:1790919427.088271:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1790919427.088289:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958174592:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919427.088668:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958174592:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 385us (667us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919427.088678:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00010000:00010000:2.0:1790919427.485387:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919427.485612:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978152704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919427.485725:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919427.487729:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152704 00000100:00100000:2.0:1790919427.487744:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152704 00000100:00100000:2.0:1790919427.487825:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919427.487839:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978152704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919427.487889:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919427.487988:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978152704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919427.487997:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790919427.488157:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32a00 x1877914978152704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919427.488185:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978152704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790919427.488294:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919427.488767:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978152832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919427.488832:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919427.489099:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978152832 00000100:00100000:3.0:1790919427.489106:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978152832 00000100:00100000:3.0:1790919427.489169:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919427.489179:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978152832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919427.489200:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919427.489282:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978152832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919427.489289:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1790919427.489741:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919427.489820:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24a80 x1877914978152832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919427.489842:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978152832:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1790919428.347554:0:9918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe55dda2f0 20000000:00000080:1.0:1790919428.347571:0:9918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f285eb7c00 uarg=0000000000000000 20000000:01000000:1.0:1790919428.347667:0:9918:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790919428.347673:0:9918:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790919428.347678:0:9918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790919428.350286:0:9919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1790919428.350443:0:9918:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790919428.358583:0:9918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790919428.358641:0:9918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790919428.360183:0:9918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790919428.360351:0:9918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790919428.360375:0:9918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360394:0:9918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591337a expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360403:0:9918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591340d expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360409:0:9918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913461 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360416:0:9918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159134bc expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360425:0:9918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 9 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360432:0:9918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360474:0:9918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 9 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.360490:0:9918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 9 pid: 6440 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.360504:0:9918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978152960:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919428.361424:0:9918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159134bc expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.361451:0:9918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159134bc expref: 23 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.361463:0:9918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153088:0@lo:104: 00000100:00100000:1.0:1790919428.361511:0:9918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919428.361557:0:9918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913461 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.361564:0:9918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913461 expref: 23 pid: 6438 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.361572:0:9918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153216:0@lo:104: 00000100:00100000:1.0:1790919428.361598:0:9918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919428.361634:0:9918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591340d expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.361643:0:9918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591340d expref: 23 pid: 6439 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.361651:0:9918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153344:0@lo:104: 00010000:00010000:1.0:1790919428.361676:0:9918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591337a expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.361701:0:9918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591337a expref: 23 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.361710:0:9918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153472:0@lo:104: 00000100:00100000:1.0:1790919428.361729:0:9918:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919428.361744:0:6428:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790919428.361763:0:6428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919428.361776:0:6428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919428.361784:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153088 00000100:00100000:3.0:1790919428.361791:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153088 00000100:00100000:3.0:1790919428.361832:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153216 00000100:00100000:3.0:1790919428.361835:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153216 00000100:00100000:3.0:1790919428.361848:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153344 00000100:00100000:3.0:1790919428.361850:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153344 00000100:00100000:3.0:1790919428.361858:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153472 00000100:00100000:3.0:1790919428.361861:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153472 00000100:00100000:3.0:1790919428.361873:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919428.361881:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9918:x1877914978153088:12345-0@lo:104: 00010000:00010000:3.0:1790919428.361894:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.361972:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919428.361978:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:9918:x1877914978153088:12345-0@lo:104: Request processed in 98us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.361986:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919428.362005:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919428.362011:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:9918:x1877914978153216:12345-0@lo:104: 00010000:00010000:3.0:1790919428.362019:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362075:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919428.362081:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:9918:x1877914978153216:12345-0@lo:104: Request processed in 71us (482us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919428.362086:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1790919428.362093:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1790919428.362093:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362109:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919428.362113:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362121:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919428.362122:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 10000000:00010000:2.0:1790919428.362128:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919428.362129:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:9918:x1877914978153344:12345-0@lo:104: 10000000:01000000:2.0:1790919428.362135:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919428.362136:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362162:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362167:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1790919428.362169:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790919428.362171:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:9918:x1877914978153344:12345-0@lo:104: Request processed in 44us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.362176:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790919428.362188:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1790919428.362189:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919428.362193:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:9918:x1877914978153472:12345-0@lo:104: 00010000:00010000:2.0:1790919428.362196:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c400/0x951c50ad159134bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159134c3 expref: -99 pid: 9028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362200:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362218:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919428.362222:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362228:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919428.362231:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362239:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919428.362244:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:9918:x1877914978153472:12345-0@lo:104: Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.362249:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1790919428.362257:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362264:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1790919428.362264:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362268:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919428.362269:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919428.362275:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ae00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919428.362278:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362283:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362288:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919428.362294:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919428.362300:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362301:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919428.362306:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919428.362308:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f38166d200/0x951c50ad15913461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913468 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362318:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362318:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919428.362321:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362324:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919428.362327:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc1a99c20) 00010000:00010000:3.0:1790919428.362330:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919428.362330:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362337:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204ae00/0x951c50ad1591340d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913414 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362338:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919428.362344:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.362346:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919428.362348:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919428.362349:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790919428.362353:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919428.362367:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362372:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919428.362378:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362384:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f381697e00/0x951c50ad1591337a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913381 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362398:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919428.362399:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919428.362401:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919428.362414:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919428.362425:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978153600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.362457:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919428.362488:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919428.362493:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978153984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.362515:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919428.362542:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978153728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.362564:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919428.362580:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919428.362586:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978153856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.362606:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919428.362635:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153600 00000100:00100000:2.0:1790919428.362639:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153600 00010000:00010000:2.0:1790919428.362666:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159134bc expref: 24 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.362694:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153984 00000100:00100000:2.0:1790919428.362697:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153984 00010000:00010000:2.0:1790919428.362708:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591337a expref: 25 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.362717:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153728 00000100:00100000:2.0:1790919428.362719:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153728 00010000:00010000:2.0:1790919428.362727:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913461 expref: 26 pid: 6438 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.362735:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978153856 00000100:00100000:2.0:1790919428.362737:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978153856 00010000:00010000:2.0:1790919428.362744:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591340d expref: 27 pid: 6439 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.362755:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919428.362760:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+27:3461:x1877914978153600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919428.362769:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919428.362773:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159134bc expref: 27 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362781:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159134bc expref: 27 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362796:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919428.362823:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+27:3461:x1877914978153600:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.362829:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919428.362855:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919428.362861:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+26:3461:x1877914978153984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919428.362871:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919428.362876:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591337a expref: 26 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362883:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591337a expref: 26 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362892:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919428.362914:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+26:3461:x1877914978153984:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.362920:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919428.362931:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919428.362937:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+25:3458:x1877914978153728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919428.362943:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919428.362947:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913461 expref: 25 pid: 6438 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362954:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913461 expref: 25 pid: 6438 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.362963:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919428.362988:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+25:3458:x1877914978153728:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.362993:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919428.363004:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919428.363009:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978153856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919428.363025:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919428.363029:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591340d expref: 24 pid: 6439 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.363036:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591340d expref: 24 pid: 6439 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.363045:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919428.363089:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978153856:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.363095:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919428.363153:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978153856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.363162:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978153728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.363184:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978153984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919428.363191:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978153600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919428.363564:0:9918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6487a00/0x951c50ad159134c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159134bc expref: 23 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.363576:0:9918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153088:0@lo:104: 00010000:00010000:1.0:1790919428.363583:0:9918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697800/0x951c50ad15913468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913461 expref: 22 pid: 6438 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.363591:0:9918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153216:0@lo:104: 00010000:00010000:1.0:1790919428.363598:0:9918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204a000/0x951c50ad15913414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591340d expref: 21 pid: 6439 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.363661:0:9918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153344:0@lo:104: 00010000:00010000:1.0:1790919428.363675:0:9918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166c200/0x951c50ad15913381 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591337a expref: 20 pid: 6440 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919428.363790:0:9918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978153472:0@lo:104: 00000100:00100000:1.0:1790919428.369798:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919428.370204:0:9918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:9918:1877914978152960:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919428.370288:0:9918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.370433:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174720 00000100:00100000:2.0:1790919428.370441:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174720 00010000:00010000:2.0:1790919428.370475:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 10 pid: 6440 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.370505:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790919428.370514:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8157f22-2e62-481b-a08b-6545627fb184+10:2413:x1877914958174720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919428.370529:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919428.370535:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 10 pid: 6440 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370558:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 10 pid: 6440 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370573:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204aa00/0x951c50ad159135db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38adb expref: 10 pid: 6440 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370591:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370599:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370675:0:6431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370684:0:6431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370692:0:6431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370698:0:6431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370704:0:6431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6487e00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919428.370708:0:6431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370717:0:6431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370748:0:6431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919428.370758:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919428.370774:0:9918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.370781:0:9918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919428.370786:0:9918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6487e00/0x951c50ad1591369f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919428.370814:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8157f22-2e62-481b-a08b-6545627fb184+9:2413:x1877914958174720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 300us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.370821:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790919428.474355:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.474462:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174848 00000100:00100000:3.0:1790919428.474472:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174848 00000100:00100000:3.0:1790919428.474528:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:3.0:1790919428.474537:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+9:6386:x1877914958174848:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919428.474554:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919428.474574:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b21 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.474618:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.474640:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919428.474650:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c200, rc 0) 00000100:00100000:3.0:1790919428.474903:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958174848:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 366us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.474911:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:3.0:1790919428.483207:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919428.485980:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958174976 00000100:00100000:2.0:1790919428.485994:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958174976 00000100:00100000:2.0:1790919428.486077:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:2.0:1790919428.486088:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958174976:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919428.486596:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958174976:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 495us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.486613:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1790919428.496465:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919428.496559:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175104 00000100:00100000:0.0:1790919428.496569:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175104 00000100:00100000:0.0:1790919428.496630:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:0.0:1790919428.496640:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958175104:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919428.496870:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:6386:x1877914958175104:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 231us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919428.496878:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00010000:00010000:3.0:1790919428.508197:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919428.520789:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919428.527952:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175232 00000100:00100000:2.0:1790919428.527970:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175232 00000100:00100000:2.0:1790919428.528024:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1790919428.528033:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:6923:x1877914958175232:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919428.528319:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:6923:x1877914958175232:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 286us (7537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919428.528328:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:3.0:1790919428.559419:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.559459:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.559564:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.559587:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.559616:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.559638:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919428.559666:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175744 00000100:00100000:3.0:1790919428.559675:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175744 00000100:00100000:3.0:1790919428.559723:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175616 00000100:00100000:3.0:1790919428.559727:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175616 00000100:00100000:3.0:1790919428.559760:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790919428.559775:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958175744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919428.559846:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958175744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.559853:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790919428.559882:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1790919428.559889:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958175616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919428.559917:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958175616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.559924:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1790919428.559955:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176000 00000100:00100000:3.0:1790919428.559959:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176000 00000100:00100000:3.0:1790919428.559984:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175872 00000100:00100000:3.0:1790919428.559987:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175872 00000100:00100000:3.0:1790919428.560008:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790919428.560015:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958176000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919428.560041:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958176000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.560047:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790919428.560079:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790919428.560086:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958175872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919428.560110:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958175872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919428.560116:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00080000:3.0:1790919428.560137:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919428.560142:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919428.560144:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919428.560146:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919428.561093:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175360 00000100:00100000:1.0:1790919428.561101:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175360 00000100:00100000:1.0:1790919428.561132:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958175488 00000100:00100000:1.0:1790919428.561135:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958175488 00000100:00100000:1.0:1790919428.561160:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:1.0:1790919428.561166:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:6923:x1877914958175360:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919428.561505:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:6923:x1877914958175360:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 338us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919428.561514:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:1.0:1790919428.561536:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:1.0:1790919428.561541:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958175488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919428.561577:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958175488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919428.561583:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:3.0:1790919429.020431:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978154112:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020505:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020544:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978154624:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020588:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020609:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978155136:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020634:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020650:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978155648:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020669:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020690:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790919429.020695:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978154496:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020716:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020734:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978155008:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020752:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020768:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978155520:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020788:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020815:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978154240:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020839:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020856:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978154752:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020894:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020911:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978155264:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020929:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020945:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790919429.020951:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978154368:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.020972:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.020988:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978154880:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021021:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.021036:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978155392:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021089:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.021117:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154112 00000100:00100000:3.0:1790919429.021126:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154112 00000100:00100000:3.0:1790919429.021176:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790919429.021184:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3461:x1877914978154112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021244:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3461:x1877914978154112:12345-0@lo:400:kworker.0 Request processed in 61us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021251:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790919429.021281:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154624 00000100:00100000:3.0:1790919429.021285:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154624 00000100:00100000:3.0:1790919429.021303:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154240 00000100:00100000:3.0:1790919429.021306:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154240 00000100:00100000:3.0:1790919429.021316:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154752 00000100:00100000:3.0:1790919429.021319:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154752 00000100:00100000:3.0:1790919429.021339:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155264 00000100:00100000:3.0:1790919429.021341:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155264 00000100:00100000:3.0:1790919429.021352:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154880 00000100:00100000:3.0:1790919429.021354:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154880 00000100:00100000:3.0:1790919429.021365:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155392 00000100:00100000:3.0:1790919429.021367:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155392 00000100:00100000:3.0:1790919429.021379:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790919429.021386:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978154624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021417:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978154624:12345-0@lo:400:kworker.0 Request processed in 32us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021423:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790919429.021436:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790919429.021443:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978154240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021473:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978154240:12345-0@lo:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021485:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790919429.021496:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790919429.021502:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978154752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021531:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978154752:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021537:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790919429.021548:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919429.021554:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978155264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021580:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978155264:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021586:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919429.021598:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790919429.021603:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978154880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021630:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978154880:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021635:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790919429.021650:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790919429.021656:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978155392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021683:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978155392:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021688:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790919429.021707:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155136 00000100:00100000:3.0:1790919429.021710:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155136 00000100:00100000:3.0:1790919429.021730:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155648 00000100:00100000:3.0:1790919429.021732:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155648 00000100:00100000:3.0:1790919429.021754:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155008 00000100:00100000:3.0:1790919429.021758:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155008 00000100:00100000:3.0:1790919429.021769:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155520 00000100:00100000:3.0:1790919429.021772:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155520 00000100:00100000:3.0:1790919429.021784:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919429.021789:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978155136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021820:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978155136:12345-0@lo:400:kworker.0 Request processed in 31us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021826:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919429.021838:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790919429.021845:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978155648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021872:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978155648:12345-0@lo:400:kworker.0 Request processed in 28us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021878:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790919429.021890:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790919429.021896:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021921:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978155008:12345-0@lo:400:kworker.0 Request processed in 26us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021926:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790919429.021936:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919429.021942:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978155520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.021970:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978155520:12345-0@lo:400:kworker.0 Request processed in 28us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.021975:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919429.021997:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154496 00000100:00100000:3.0:1790919429.022000:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154496 00000100:00100000:3.0:1790919429.022022:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978154368 00000100:00100000:3.0:1790919429.022032:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978154368 00000100:00100000:3.0:1790919429.022073:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790919429.022080:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978154496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022116:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978154496:12345-0@lo:400:kworker.0 Request processed in 36us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.022121:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790919429.022133:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790919429.022139:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978154368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022163:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978154368:12345-0@lo:400:kworker.0 Request processed in 25us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.022169:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1790919429.022222:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919429.022226:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919429.022229:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919429.022231:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919429.022264:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978154368:0@lo:400:kworker.0 00010000:00080000:3.0:1790919429.022278:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658ed80 x1877914978154880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919429.022289:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978154880:0@lo:400:kworker.0 00010000:00080000:3.0:1790919429.022300:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658c700 x1877914978155392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919429.022308:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978155392:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022320:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978154240:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022329:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978154752:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022353:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978155264:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022394:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978154496:0@lo:400:kworker.0 00010000:00080000:3.0:1790919429.022405:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658f800 x1877914978155008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919429.022413:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978155008:0@lo:400:kworker.0 00010000:00080000:3.0:1790919429.022423:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658ce00 x1877914978155520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919429.022430:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978155520:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022439:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978154112:0@lo:400:kworker.0 00000100:00100000:3.0:1790919429.022448:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978154624:0@lo:400:kworker.0 00010000:00080000:3.0:1790919429.022458:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658df80 x1877914978155136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919429.022466:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978155136:0@lo:400:kworker.0 00010000:00080000:3.0:1790919429.022476:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658f480 x1877914978155648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919429.022484:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978155648:0@lo:400:kworker.0 00000100:00100000:2.0:1790919429.022633:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919429.022643:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978155776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919429.022679:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919429.022714:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155776 00000100:00100000:2.0:1790919429.022725:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155776 00000100:00100000:2.0:1790919429.022754:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919429.022760:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978155776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919429.022788:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919429.022823:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978155776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919429.022829:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790919429.022860:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32a00 x1877914978155776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919429.022889:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978155776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919429.028772:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978155904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919429.028843:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919429.029231:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978155904 00000100:00100000:2.0:1790919429.029240:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978155904 00000100:00100000:2.0:1790919429.029297:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919429.029308:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978155904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919429.029333:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919429.029382:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978155904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919429.029390:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1790919429.029535:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32a00 x1877914978155904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919429.029554:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978155904:0@lo:13:osp-pre-1-1.0 10000000:01000000:3.0:1790919429.538045:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919429.538073:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3a6ada000 from 4 10000000:01000000:3.0:1790919429.538079:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919429.538125:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.538150:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.538177:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919429.538216:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.538293:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.538329:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6468e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.538545:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156032 00000100:00100000:0.0:1790919429.538563:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156032 00000100:00100000:0.0:1790919429.539461:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790919429.539482:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978156032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919429.539508:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919429.539532:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159136ad expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.539572:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159136ad expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.539585:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136ad expref: 21 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.539618:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015600, rc 0) 00000100:00100000:0.0:1790919429.539716:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978156032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.539724:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790919429.541605:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919429.541643:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.541658:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919429.541987:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.542099:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.542148:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6468e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.542448:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156160 00000100:00100000:0.0:1790919429.542467:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156160 00000100:00100000:0.0:1790919429.542522:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790919429.542533:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978156160:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:3.0:1790919429.543317:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919429.543377:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978156160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 842us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.543389:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790919429.543428:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.543496:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.543568:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.543594:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6468e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.543617:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156288 00000100:00100000:0.0:1790919429.543623:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156288 00000100:00100000:0.0:1790919429.543763:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790919429.543773:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978156288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919429.543962:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978156288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.543970:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790919429.544018:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919429.544281:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9970:1877914978156416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919429.544763:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.544800:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156416 00000100:00100000:3.0:1790919429.544807:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156416 00000100:00100000:0.0:1790919429.544810:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919429.544846:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790919429.544856:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9970:x1877914978156416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919429.546352:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9970:x1877914978156416:12345-0@lo:502:llog_process_th.0 Request processed in 1489us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.546367:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790919429.547183:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9970:1877914978156416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919429.547306:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919429.547399:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919429.547403:0:9970:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790919429.547412:0:9970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3a6ada000 00000020:00000080:0.0:1790919429.547415:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790919429.547881:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9970:1877914978156544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919429.547968:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919429.548020:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156544 00000100:00100000:0.0:1790919429.548028:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156544 00000100:00100000:0.0:1790919429.548105:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790919429.548115:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9970:x1877914978156544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919429.548415:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:9970:x1877914978156544:12345-0@lo:502:llog_process_th.0 Request processed in 300us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.548424:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790919429.548475:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.549101:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9970:1877914978156544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919429.549143:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919429.549152:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919429.549155:0:9970:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790919429.549159:0:9970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790919429.549264:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790919429.549292:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919429.549305:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.549319:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919429.549332:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919429.549335:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3be491000 from 4 10000000:01000000:0.0:1790919429.549349:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919429.549390:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.549399:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.549409:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919429.549428:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919429.549490:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919429.549520:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.549541:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156672 00000100:00100000:0.0:1790919429.549944:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156672 00000100:00100000:0.0:1790919429.549995:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790919429.550004:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978156672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919429.550019:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919429.550035:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159136bb expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.550091:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159136bb expref: 22 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.550105:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136bb expref: 22 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.550116:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015800, rc 0) 00000100:00100000:0.0:1790919429.550160:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978156672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.550179:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790919429.550303:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919429.550379:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919429.550390:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919429.550453:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919429.550820:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919429.550849:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.550933:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156800 00000100:00100000:0.0:1790919429.550940:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156800 00000100:00100000:0.0:1790919429.550973:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790919429.550981:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978156800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919429.553869:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978156800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2875us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.553889:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790919429.558019:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919429.558141:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919429.558238:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919429.558282:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.558405:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978156928 00000100:00100000:0.0:1790919429.558420:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978156928 00000100:00100000:0.0:1790919429.558503:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790919429.558515:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978156928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919429.559005:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978156928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 490us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.559014:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790919429.561163:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978156928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919429.570413:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9973:1877914978157056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919429.570533:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919429.570598:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157056 00000100:00100000:2.0:1790919429.570601:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.570616:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157056 00000100:00100000:0.0:1790919429.570690:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790919429.570702:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9973:x1877914978157056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919429.571021:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9973:x1877914978157056:12345-0@lo:502:llog_process_th.0 Request processed in 319us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.571031:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790919429.571194:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9973:1877914978157056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919429.571244:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919429.571256:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919429.571259:0:9973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790919429.571268:0:9973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3be491000 00000020:00000080:2.0:1790919429.571272:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790919429.571970:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9973:1877914978157184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919429.572032:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919429.572114:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919429.577810:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157184 00000100:00100000:0.0:1790919429.577832:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157184 00000100:00100000:0.0:1790919429.577914:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790919429.577926:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9973:x1877914978157184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919429.580012:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:9973:x1877914978157184:12345-0@lo:502:llog_process_th.0 Request processed in 2077us (7968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919429.580029:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790919429.584840:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9973:1877914978157184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919429.585921:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919429.585939:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919429.585942:0:9973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790919429.585949:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790919429.588316:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790919429.588433:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919429.588449:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.588466:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919429.588480:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919429.588764:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4712800 from 4 10000000:01000000:3.0:1790919429.588767:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919429.588823:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.588834:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.588846:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919429.588880:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.588979:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.589039:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919429.590311:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157312 00000100:00100000:3.0:1790919429.590626:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157312 00000100:00100000:3.0:1790919429.591420:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790919429.591445:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978157312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919429.591471:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919429.591507:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159136c9 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.591543:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159136c9 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.591795:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136c9 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.591808:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2cc00, rc 0) 00000100:00100000:3.0:1790919429.591916:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978157312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 483us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.591925:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790919429.592028:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919429.593427:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.593449:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919429.593823:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.593906:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919429.593962:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919429.593999:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157440 00000100:00100000:3.0:1790919429.594018:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157440 00000100:00100000:3.0:1790919429.594106:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790919429.594118:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978157440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919429.595100:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978157440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 979us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919429.595112:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790919429.595280:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.595348:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.596670:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.596884:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919429.597037:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157568 00000100:00100000:2.0:1790919429.597046:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157568 00000100:00100000:2.0:1790919429.597257:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790919429.597268:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978157568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919429.597629:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978157568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 362us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919429.597637:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790919429.598903:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.599345:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9976:1877914978157696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.599411:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.599448:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157696 00000100:00100000:1.0:1790919429.599462:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157696 00000100:00100000:1.0:1790919429.599500:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790919429.599509:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9976:x1877914978157696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.599714:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9976:x1877914978157696:12345-0@lo:502:llog_process_th.0 Request processed in 205us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.599722:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790919429.599896:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.599915:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9976:1877914978157696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919429.599943:0:9976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919429.599954:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919429.599956:0:9976:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919429.599965:0:9976:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3b4712800 00000020:00000080:1.0:1790919429.599967:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919429.600544:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9976:1877914978157824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.600598:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.600630:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157824 00000100:00100000:1.0:1790919429.600636:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157824 00000100:00100000:1.0:1790919429.600670:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790919429.600677:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9976:x1877914978157824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.600983:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:9976:x1877914978157824:12345-0@lo:502:llog_process_th.0 Request processed in 306us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.600993:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790919429.601046:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.601088:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9976:1877914978157824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919429.601113:0:9976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919429.601119:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919429.601184:0:9976:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790919429.601190:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790919429.601256:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790919429.601287:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919429.601297:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601309:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919429.601318:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919429.601321:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385571800 from 4 10000000:01000000:1.0:1790919429.601324:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919429.601349:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601356:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601364:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919429.601378:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.601404:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.601423:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.601437:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978157952 00000100:00100000:1.0:1790919429.601440:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978157952 00000100:00100000:1.0:1790919429.601462:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790919429.601470:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978157952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919429.601478:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919429.601497:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159136d7 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601519:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159136d7 expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601531:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136d7 expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601539:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487c00, rc 0) 00000100:00100000:1.0:1790919429.601569:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978157952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.601575:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790919429.601607:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978157952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919429.601619:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919429.601628:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919429.601669:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978158080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.601696:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.601710:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.601721:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158080 00000100:00100000:1.0:1790919429.601724:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158080 00000100:00100000:1.0:1790919429.601746:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790919429.601752:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978158080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.602088:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978158080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.602103:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790919429.602212:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978158080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.602244:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978158208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.602285:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.602308:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.602322:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158208 00000100:00100000:1.0:1790919429.602327:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158208 00000100:00100000:1.0:1790919429.602352:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1790919429.602358:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978158208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.602490:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978158208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.602497:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1790919429.602536:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978158208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919429.603497:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9977:1877914978158336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.603549:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.603574:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158336 00000100:00100000:1.0:1790919429.603579:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158336 00000100:00100000:1.0:1790919429.603606:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1790919429.603613:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:9977:x1877914978158336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919429.605168:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.608484:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:9977:x1877914978158336:12345-0@lo:502:llog_process_th.0 Request processed in 4863us (4927us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.608500:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1790919429.608585:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9977:1877914978158336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919429.608645:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919429.608656:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919429.608659:0:9977:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919429.608667:0:9977:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f385571800 00000020:00000080:1.0:1790919429.608670:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790919429.608772:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9977:1877914978158464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.608827:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919429.608860:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158464 00000100:00100000:1.0:1790919429.608868:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158464 00000100:00100000:1.0:1790919429.608907:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790919429.608915:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:9977:x1877914978158464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919429.609138:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:9977:x1877914978158464:12345-0@lo:502:llog_process_th.0 Request processed in 221us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919429.609147:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790919429.609211:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d2a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919429.609225:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:9977:1877914978158464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919429.609244:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919429.609249:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919429.609251:0:9977:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790919429.609255:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790919429.609419:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790919429.609469:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919429.609494:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919429.609509:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919430.556464:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919431.581106:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919432.092507:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978158720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919432.092508:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978158592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919432.092611:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919432.092653:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919432.092700:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158720 00000100:00100000:1.0:1790919432.092711:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158720 00000100:00100000:1.0:1790919432.092759:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158592 00000100:00100000:1.0:1790919432.092762:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158592 00000100:00100000:1.0:1790919432.092779:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790919432.092789:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978158720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919432.092851:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919432.092900:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978158720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919432.092908:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790919432.092927:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790919432.092934:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978158592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919432.092955:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919432.092998:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978158592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919432.093007:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978158720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919432.093007:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919432.093084:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978158592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919432.604225:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919432.604256:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978158848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919432.604350:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919432.604441:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158848 00000100:00100000:0.0:1790919432.604451:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158848 00000100:00100000:0.0:1790919432.604518:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919432.604529:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978158848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919432.604593:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919432.604644:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978158848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919432.604652:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1790919432.604676:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919432.604714:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b606bb80 x1877914978158848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919432.604745:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978158848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790919432.605313:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919432.605322:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919432.605333:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978158976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919432.605380:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919432.605554:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978158976 00000100:00100000:1.0:1790919432.605562:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978158976 00000100:00100000:1.0:1790919432.605665:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919432.605685:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978158976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919432.605708:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919432.605758:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978158976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00080000:3.0:1790919432.606601:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919432.606652:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edf800 x1877914978158976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919432.606754:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978158976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919432.610492:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1790919433.628372:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919433.671938:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919433.671977:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919433.672088:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919433.672108:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919433.672130:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919433.672169:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176128 00000100:00100000:3.0:1790919433.672191:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176128 00000100:00100000:3.0:1790919433.672253:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 274 00000100:00100000:3.0:1790919433.672264:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2411:x1877914958176128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919433.672344:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2411:x1877914958176128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919433.672352:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 274 00000100:00100000:3.0:1790919433.672388:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176384 00000100:00100000:3.0:1790919433.672391:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176384 00000100:00100000:3.0:1790919433.672423:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176256 00000100:00100000:3.0:1790919433.672425:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176256 00000100:00100000:3.0:1790919433.672444:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1790919433.672451:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958176384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919433.672481:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958176384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919433.672488:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1790919433.672498:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790919433.672504:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958176256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919433.673074:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958176256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919433.673086:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790919433.673112:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176640 00000100:00100000:3.0:1790919433.673117:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176640 00000100:00100000:3.0:1790919433.673149:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176512 00000100:00100000:3.0:1790919433.673151:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176512 00000100:00100000:3.0:1790919433.673168:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790919433.673186:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958176640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919433.673233:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958176640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 47us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919433.673239:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790919433.673250:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1790919433.673256:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958176512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919433.673275:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958176512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919433.673281:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00080000:3.0:1790919433.673746:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919433.673752:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919433.673754:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919433.673757:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919434.141220:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919434.141243:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978159104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919434.141320:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919434.141394:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159104 00000100:00100000:0.0:1790919434.141402:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159104 00000100:00100000:0.0:1790919434.141458:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919434.141467:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978159104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919434.141504:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919434.141553:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978159104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919434.141560:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790919434.141601:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b606bb80 x1877914978159104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919434.141619:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978159104:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1790919434.141877:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919434.141885:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919434.141894:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978159232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919434.141925:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.141953:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159232 00000100:00100000:3.0:1790919434.141957:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159232 00000100:00100000:3.0:1790919434.142418:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919434.142430:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978159232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919434.142443:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919434.142482:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978159232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.142489:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790919434.142506:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919434.142525:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edea00 x1877914978159232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919434.142547:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978159232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919434.142654:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978159360:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.142689:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.142722:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978159872:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.142752:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.142770:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978160384:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.142795:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.142814:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790919434.142821:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978159488:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.142856:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.142872:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978160000:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.142890:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.142905:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978160512:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.142924:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.142949:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159360 00000100:00100000:3.0:1790919434.142953:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159360 00000100:00100000:3.0:1790919434.142978:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790919434.142985:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978159360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.143417:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978159360:12345-0@lo:400:kworker.0 Request processed in 430us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.143425:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790919434.143460:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159872 00000100:00100000:3.0:1790919434.143464:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159872 00000100:00100000:3.0:1790919434.143486:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159488 00000100:00100000:3.0:1790919434.143495:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159488 00000100:00100000:3.0:1790919434.143509:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160000 00000100:00100000:3.0:1790919434.143512:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160000 00000100:00100000:3.0:1790919434.143530:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160512 00000100:00100000:3.0:1790919434.143533:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160512 00000100:00100000:3.0:1790919434.143548:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919434.143553:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.143586:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978159872:12345-0@lo:400:kworker.0 Request processed in 32us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.143592:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790919434.143604:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790919434.143610:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978159488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.143639:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978159488:12345-0@lo:400:kworker.0 Request processed in 30us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.143646:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790919434.143657:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919434.143663:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978160000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.143687:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978160000:12345-0@lo:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.143692:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919434.143704:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790919434.143711:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978160512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.143736:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978160512:12345-0@lo:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.143741:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790919434.143760:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160384 00000100:00100000:3.0:1790919434.143763:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160384 00000100:00100000:3.0:1790919434.143797:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919434.143805:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978160384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145222:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978160384:12345-0@lo:400:kworker.0 Request processed in 33us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.145234:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790919434.145293:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919434.145299:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919434.145314:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978159616:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145364:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.145397:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978160128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145420:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.145437:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978160640:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145458:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.145479:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790919434.145487:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978159744:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145510:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.145530:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978160256:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145551:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919434.145578:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160128 00000100:00100000:3.0:1790919434.145585:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160128 00000100:00100000:3.0:1790919434.145618:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160640 00000100:00100000:3.0:1790919434.145621:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160640 00000100:00100000:3.0:1790919434.145646:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790919434.145654:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978160128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145702:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978160128:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.145708:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790919434.145732:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919434.145739:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978160640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145768:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978160640:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.145774:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919434.145791:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159616 00000100:00100000:3.0:1790919434.145794:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159616 00000100:00100000:3.0:1790919434.145816:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978159744 00000100:00100000:3.0:1790919434.145818:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978159744 00000100:00100000:3.0:1790919434.145830:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790919434.145846:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978159616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145881:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978159616:12345-0@lo:400:kworker.0 Request processed in 45us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.145887:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790919434.145898:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790919434.145905:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978159744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.145935:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978159744:12345-0@lo:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.145940:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790919434.145958:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160256 00000100:00100000:3.0:1790919434.145962:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160256 00000100:00100000:3.0:1790919434.146010:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919434.146019:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978160256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.146077:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978160256:12345-0@lo:400:kworker.0 Request processed in 60us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919434.146085:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790919434.147506:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919434.147515:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919434.147641:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978159488:0@lo:400:kworker.0 00000100:00100000:2.0:1790919434.147670:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978160000:0@lo:400:kworker.0 00000100:00100000:2.0:1790919434.147683:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978160512:0@lo:400:kworker.0 00000100:00100000:2.0:1790919434.147693:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978159360:0@lo:400:kworker.0 00000100:00100000:2.0:1790919434.147705:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978159872:0@lo:400:kworker.0 00010000:00080000:2.0:1790919434.147719:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edce00 x1877914978160384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919434.147729:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978160384:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.148672:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978159744:0@lo:400:kworker.0 00010000:00080000:3.0:1790919434.148700:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edc380 x1877914978160256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919434.148708:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978160256:0@lo:400:kworker.0 00000100:00100000:3.0:1790919434.148719:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978159616:0@lo:400:kworker.0 00010000:00080000:3.0:1790919434.148729:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edd500 x1877914978160128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919434.148738:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978160128:0@lo:400:kworker.0 00010000:00080000:3.0:1790919434.148749:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658f480 x1877914978160640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919434.148756:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978160640:0@lo:400:kworker.0 00010000:00010000:2.0:1790919434.653301:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919434.697408:0:10220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1790919435.681462:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919436.701168:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919437.212233:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978160768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919437.212301:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919437.212439:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160768 00000100:00100000:2.0:1790919437.212447:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160768 00000100:00100000:1.0:1790919437.212458:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919437.212467:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978160896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919437.212495:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919437.212496:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919437.212504:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978160768:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919437.212527:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978160896 00000100:00100000:1.0:1790919437.212531:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978160896 00000004:00000024:2.0:1790919437.212542:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919437.212548:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790919437.212553:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978160896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919437.212582:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919437.212620:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978160896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919437.212626:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790919437.212670:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978160896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919437.212800:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978160768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 297us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919437.212807:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919437.212836:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978160768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790919437.727635:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919437.729939:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919437.730007:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919437.730100:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161024 00000100:00100000:0.0:1790919437.730109:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161024 00000100:00100000:0.0:1790919437.730172:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919437.730182:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978161024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919437.730237:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919437.730287:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978161024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919437.730294:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1790919437.730331:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b6068000 x1877914978161024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919437.730349:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919437.730388:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919437.730396:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978161152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919437.730421:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919437.730533:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161152 00000100:00100000:3.0:1790919437.730537:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161152 00000100:00100000:3.0:1790919437.730571:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790919437.730580:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978161152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919437.730590:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919437.730632:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978161152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919437.730638:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1790919437.730715:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919437.730850:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658f480 x1877914978161152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919437.730864:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978161152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790919438.749369:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919438.810162:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919438.810212:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919438.810239:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919438.810260:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919438.810350:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919438.810437:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177024 00000100:00100000:2.0:1790919438.810448:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177024 00000100:00100000:2.0:1790919438.810521:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176896 00000100:00100000:2.0:1790919438.810524:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176896 00000100:00100000:2.0:1790919438.810548:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:2.0:1790919438.810558:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958177024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919438.810649:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958177024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919438.810657:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:2.0:1790919438.810674:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:2.0:1790919438.810681:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958176896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919438.810708:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958176896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919438.810714:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1790919438.810725:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177152 00000100:00100000:3.0:1790919438.810729:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177152 00000100:00100000:3.0:1790919438.810766:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177280 00000100:00100000:3.0:1790919438.810769:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177280 00000100:00100000:3.0:1790919438.810790:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790919438.810797:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2410:x1877914958177152:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:3.0:1790919438.810831:0:8248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135f0 00000100:00100000:2.0:1790919438.810832:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919438.810839:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2410:x1877914958177280:12345-192.168.203.11@tcp:9:kworker.0 00000100:00080000:3.0:1790919438.810841:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f38716a000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1790919438.810854:0:8084:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135f7 00000100:00080000:2.0:1790919438.810861:0:8084:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919438.810880:0:8248:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:2.0:1790919438.810880:0:8084:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790919438.811146:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+2:2410:x1877914958177280:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 295us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919438.811154:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00010000:00010000:2.0:1790919438.811173:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919438.811208:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919438.811293:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919438.811298:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919438.811300:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919438.811302:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919438.811409:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+2:2410:x1877914958177152:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 611us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919438.811416:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790919438.811505:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958176768 00000100:00100000:1.0:1790919438.811510:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958176768 00000100:00100000:1.0:1790919438.813121:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 276 00000100:00100000:1.0:1790919438.813149:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958176768:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919438.813221:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958176768:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919438.813229:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 276 00000001:02000400:1.0:1790919438.937525:0:10464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing yml_node 00000100:00100000:3.0:1790919439.262886:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978161280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919439.262956:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919439.263587:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161280 00000100:00100000:3.0:1790919439.263597:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161280 00000100:00100000:3.0:1790919439.263650:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919439.263665:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978161280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919439.263700:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919439.263749:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978161280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919439.263756:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790919439.263804:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919439.263839:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658ed80 x1877914978161280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919439.263858:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978161280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919439.264389:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978161664:0@lo:400:kworker.0 00000100:00100000:3.0:1790919439.264424:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919439.264494:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978161792:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268523:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978161408:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268606:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268681:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978161920:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268710:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268734:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978162432:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268763:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268783:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978162944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919439.268808:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268835:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790919439.268842:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978161536:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268865:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268885:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978162048:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268906:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268923:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978162560:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.268954:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.268989:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161920 00000100:00100000:0.0:1790919439.268997:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161920 00000100:00100000:0.0:1790919439.269030:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161536 00000100:00100000:0.0:1790919439.269033:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161536 00000100:00100000:0.0:1790919439.269042:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162048 00000100:00100000:0.0:1790919439.269043:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162048 00000100:00100000:0.0:1790919439.269095:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162560 00000100:00100000:0.0:1790919439.269098:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162560 00000100:00100000:0.0:1790919439.269121:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790919439.269138:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978161920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269192:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978161920:12345-0@lo:400:kworker.0 Request processed in 63us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.269199:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790919439.269215:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790919439.269227:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978161536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269335:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978161536:12345-0@lo:400:kworker.0 Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.269341:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790919439.269354:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790919439.269359:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978162048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269384:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978162048:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.269390:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790919439.269399:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790919439.269404:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269422:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978162560:12345-0@lo:400:kworker.0 Request processed in 19us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.269428:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790919439.269443:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162432 00000100:00100000:0.0:1790919439.269446:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162432 00000100:00100000:0.0:1790919439.269469:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919439.269474:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978162432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269499:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfe9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978162432:12345-0@lo:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.269505:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919439.269678:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162944 00000100:00100000:0.0:1790919439.269681:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162944 00000100:00100000:0.0:1790919439.269702:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790919439.269708:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978162944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919439.269721:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919439.269754:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978162944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.269760:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1790919439.269784:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919439.269788:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919439.269790:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919439.269815:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978161536:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269824:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978162048:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269831:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978162560:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.269838:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978161920:0@lo:400:kworker.0 00010000:00080000:0.0:1790919439.269865:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edd880 x1877914978162432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919439.269875:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978162432:0@lo:400:kworker.0 00010000:00080000:0.0:1790919439.269883:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b6068e00 x1877914978162944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919439.269895:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978162944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919439.271765:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161408 00000100:00100000:2.0:1790919439.271779:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161408 00000100:00100000:2.0:1790919439.271822:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790919439.271830:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978161408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.271908:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978161408:12345-0@lo:400:kworker.0 Request processed in 79us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919439.271922:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790919439.271977:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978161408:0@lo:400:kworker.0 00000100:00100000:1.0:1790919439.273761:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161664 00000100:00100000:1.0:1790919439.273773:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161664 00000100:00100000:1.0:1790919439.273826:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790919439.273835:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.273959:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919439.274147:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978162304:0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.274199:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919439.274219:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978162816:0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.274239:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919439.274358:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978161664:12345-0@lo:400:kworker.0 Request processed in 524us (9932us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919439.274367:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790919439.274384:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978161792 00000100:00100000:1.0:1790919439.274388:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978161792 00000100:00100000:2.0:1790919439.274433:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919439.274439:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978162688:0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.274465:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919439.274491:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162304 00000100:00100000:2.0:1790919439.274495:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162304 00000100:00100000:2.0:1790919439.274526:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162816 00000100:00100000:2.0:1790919439.274528:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162816 00000100:00100000:2.0:1790919439.274542:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919439.274547:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978162304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.274579:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978162304:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919439.274584:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919439.274594:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919439.274599:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978162816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.274623:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978162816:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919439.274628:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790919439.274646:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919439.274675:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162688 00000100:00100000:2.0:1790919439.274679:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162688 00000100:00100000:2.0:1790919439.274708:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790919439.274714:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978162688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919439.274745:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978162688:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919439.274751:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1790919439.274766:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790919439.274790:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edf100 x1877914978162688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919439.274804:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978162688:0@lo:400:kworker.0 00010000:00080000:2.0:1790919439.274815:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edd500 x1877914978162304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919439.274824:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978162304:0@lo:400:kworker.0 00010000:00080000:2.0:1790919439.274833:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edce00 x1877914978162816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919439.274841:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978162816:0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.274922:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790919439.274932:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978161792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.274970:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978161792:12345-0@lo:400:kworker.0 Request processed in 40us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.274975:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790919439.275034:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978161792:0@lo:400:kworker.0 00000100:00100000:3.0:1790919439.275216:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978161664:0@lo:400:kworker.0 00000100:00100000:3.0:1790919439.275225:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978162176:0@lo:400:kworker.0 00000100:00100000:3.0:1790919439.275334:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919439.275625:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978162176 00000100:00100000:0.0:1790919439.275631:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978162176 00000100:00100000:0.0:1790919439.275685:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790919439.275700:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978162176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919439.275739:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978162176:12345-0@lo:400:kworker.0 Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919439.275746:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1790919439.275786:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790919439.275828:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32a00 x1877914978162176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919439.275838:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978162176:0@lo:400:kworker.0 00010000:00010000:3.0:1790919439.773233:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919440.799536:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790919441.358437:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:2.0:1790919441.358449:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f38716a800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:3.0:1790919441.359210:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f38716a800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-OST0000 00000020:00000080:3.0:1790919441.359344:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f38716a000 for lustre-OST0000 00010000:00010000:2.0:1790919441.820342:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919442.333132:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919442.333166:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978163072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919442.333265:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919442.333811:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978163200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919442.333851:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919442.334010:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163072 00000100:00100000:0.0:1790919442.334023:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163072 00000100:00100000:0.0:1790919442.334101:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163200 00000100:00100000:0.0:1790919442.334186:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163200 00000100:00100000:0.0:1790919442.334214:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919442.334224:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978163072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919442.334277:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919442.334341:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978163072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919442.334349:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919442.334371:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790919442.334377:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978163200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919442.334405:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919442.334436:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978163200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919442.334442:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790919442.334861:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978163200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919442.334906:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978163072:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1790919442.432423:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:1.0:1790919442.432433:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f3b65b6800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:1.0:1790919442.432508:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b6800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-OST0001 00000020:00000080:1.0:1790919442.432560:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65b0000 for lustre-OST0001 00000001:02000400:2.0:1790919442.509564:0:10657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00000100:00100000:0.0:1790919442.844344:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919442.844364:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978163328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919442.844431:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919442.844488:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978163456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919442.844515:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919442.844551:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163328 00000100:00100000:0.0:1790919442.844564:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163328 00000100:00100000:0.0:1790919442.844614:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163456 00000100:00100000:0.0:1790919442.844618:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163456 00000100:00100000:0.0:1790919442.844634:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790919442.844641:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978163328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919442.844673:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919442.844715:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978163328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919442.844722:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790919442.844738:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790919442.844744:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978163456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919442.844756:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919442.844785:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978163456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919442.844791:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1790919442.844829:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843e9500 x1877914978163456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919442.844845:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978163456:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790919442.844873:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843ea680 x1877914978163328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919442.846040:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978163328:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790919442.846657:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790919442.847000:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919443.868222:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919443.911092:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919443.911153:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177536 00000100:00100000:2.0:1790919443.911158:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919443.911164:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177536 00000100:00100000:2.0:1790919443.911197:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919443.911224:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177664 00000100:00100000:2.0:1790919443.911228:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177664 00000100:00100000:0.0:1790919443.911243:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:1.0:1790919443.911302:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177408 00000100:00100000:1.0:1790919443.911307:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177408 00000100:00100000:2.0:1790919443.911311:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:2.0:1790919443.911322:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958177664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919443.911343:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 278 00000100:00100000:1.0:1790919443.911353:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2411:x1877914958177408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:3.0:1790919443.911423:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919443.911428:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919443.911463:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958177664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919443.911471:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1790919443.911491:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958177536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919443.912280:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2411:x1877914958177408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 927us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919443.912290:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 278 00000100:00100000:0.0:1790919443.912395:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958177536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1142us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919443.912403:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000001:02000400:3.0:1790919444.344354:0:10754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00000100:00100000:1.0:1790919444.381047:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978163584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919444.381256:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978163840:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381322:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381386:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978164352:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381507:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381536:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978164864:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381562:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381597:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1790919444.381603:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978163712:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381632:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381654:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978164224:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381694:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381714:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978164736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381740:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381755:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978165248:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381804:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381837:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978163968:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.381876:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381881:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381918:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978164480:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.381929:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978164096:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.381945:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381962:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978164992:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.381973:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.381993:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.382029:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163840 00000100:00100000:1.0:1790919444.382033:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978164608:0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.382037:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163840 00000100:00100000:1.0:1790919444.382079:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.382109:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164352 00000100:00100000:2.0:1790919444.382114:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164352 00000100:00100000:1.0:1790919444.382114:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978165120:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.382139:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919444.382169:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163968 00000100:00100000:1.0:1790919444.382173:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163968 00000100:00100000:1.0:1790919444.382196:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164096 00000100:00100000:1.0:1790919444.382199:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164096 00000100:00100000:1.0:1790919444.382215:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790919444.382223:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.382267:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164864 00000100:00100000:2.0:1790919444.382272:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164864 00000100:00100000:1.0:1790919444.382285:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978163968:12345-0@lo:400:kworker.0 Request processed in 60us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.382291:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164224 00000100:00100000:1.0:1790919444.382295:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919444.382296:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164224 00000100:00100000:2.0:1790919444.382311:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164480 00000100:00100000:2.0:1790919444.382315:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164480 00000100:00100000:1.0:1790919444.382326:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790919444.382333:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164992 00000100:00100000:1.0:1790919444.382337:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978164096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.382338:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164992 00000100:00100000:2.0:1790919444.382360:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790919444.382370:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978163840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.382382:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978164096:12345-0@lo:400:kworker.0 Request processed in 48us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919444.382389:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790919444.382420:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978163840:12345-0@lo:400:kworker.0 Request processed in 50us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.382429:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790919444.382445:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919444.382452:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978164352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.382484:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978164352:12345-0@lo:400:kworker.0 Request processed in 33us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.382501:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919444.382518:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919444.382526:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978164864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.382568:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978164096:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.383089:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163584 00000100:00100000:1.0:1790919444.383105:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163584 00000100:00100000:1.0:1790919444.383135:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919444.383142:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978163584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919444.383168:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919444.383230:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790919444.383244:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978164224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.384207:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978164864:12345-0@lo:400:kworker.0 Request processed in 1679us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.384216:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790919444.384232:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978163584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1088us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919444.384240:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919444.384244:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919444.384256:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978164480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.384268:0:6447:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790919444.384277:0:6447:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790919444.384294:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919444.384301:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978164480:12345-0@lo:400:kworker.0 Request processed in 48us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919444.384309:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978165376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919444.384310:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919444.384330:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919444.384340:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978164992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.384350:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919444.384383:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978164992:12345-0@lo:400:kworker.0 Request processed in 45us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919444.384387:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165376 00000100:00100000:2.0:1790919444.384392:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790919444.384393:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165376 00000100:00100000:2.0:1790919444.384424:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978163712 00000100:00100000:2.0:1790919444.384430:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978163712 00000100:00100000:1.0:1790919444.384431:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919444.384441:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978165376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919444.384455:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919444.384467:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1790919444.384478:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978163712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.384493:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978165376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919444.384501:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790919444.384520:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978163712:12345-0@lo:400:kworker.0 Request processed in 44us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.384528:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1790919444.384559:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164736 00000100:00100000:2.0:1790919444.384564:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164736 00000100:00100000:2.0:1790919444.384597:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165248 00000100:00100000:2.0:1790919444.384601:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165248 00000100:00100000:2.0:1790919444.384614:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978164608 00000100:00100000:2.0:1790919444.384617:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978164608 00010000:00080000:1.0:1790919444.384623:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a01c00 x1877914978165376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919444.384630:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165120 00000100:00100000:2.0:1790919444.384634:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165120 00000100:00100000:1.0:1790919444.384644:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978165376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919444.384651:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919444.384660:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978164736:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790919444.384679:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edf100 x1877914978163584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919444.384695:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978163584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919444.384702:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978164736:12345-0@lo:400:kworker.0 Request processed in 42us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.384709:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919444.384723:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919444.384731:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978165248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.384764:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978165248:12345-0@lo:400:kworker.0 Request processed in 35us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.384769:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919444.386644:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919444.386662:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978164608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.386872:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978164608:12345-0@lo:400:kworker.0 Request processed in 216us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.386880:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919444.386901:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919444.386908:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978165120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919444.386944:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978165120:12345-0@lo:400:kworker.0 Request processed in 37us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919444.386950:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1790919444.386994:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919444.387008:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919444.387011:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919444.387014:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919444.387065:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978163968:0@lo:400:kworker.0 00010000:00080000:2.0:1790919444.387082:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac1500 x1877914978164480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919444.387104:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978164480:0@lo:400:kworker.0 00010000:00080000:2.0:1790919444.387120:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac0700 x1877914978164992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919444.387138:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978164992:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.387159:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978163712:0@lo:400:kworker.0 00010000:00080000:1.0:1790919444.387178:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac1180 x1877914978164736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919444.387189:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978164736:0@lo:400:kworker.0 00010000:00080000:1.0:1790919444.387241:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac0380 x1877914978165248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919444.387251:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978165248:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.387262:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978163840:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.387273:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978164352:0@lo:400:kworker.0 00000100:00100000:1.0:1790919444.387283:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978164864:0@lo:400:kworker.0 00000100:00100000:3.0:1790919444.387556:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978164224:12345-0@lo:400:kworker.0 Request processed in 4316us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919444.387565:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919444.392036:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978164224:0@lo:400:kworker.0 00010000:00080000:0.0:1790919444.394628:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac2d80 x1877914978164608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919444.394645:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978164608:0@lo:400:kworker.0 00010000:00080000:1.0:1790919444.394711:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac1f80 x1877914978165120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919444.394722:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978165120:0@lo:400:kworker.0 00010000:00010000:2.0:1790919444.892293:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919445.919649:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919446.319472:0:10853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:2.0:1790919446.940368:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919447.454637:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919447.454662:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978165504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919447.454793:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919447.454861:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165504 00000100:00100000:0.0:1790919447.454867:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165504 00000100:00100000:0.0:1790919447.454908:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790919447.454916:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978165504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919447.454955:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919447.455000:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978165504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919447.455008:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790919447.455081:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978165504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919447.458947:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978165632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919447.459027:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919447.459807:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165632 00000100:00100000:2.0:1790919447.459816:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165632 00000100:00100000:2.0:1790919447.459864:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790919447.459873:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978165632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919447.459910:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919447.459963:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978165632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919447.459970:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790919447.461890:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978165632:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1790919447.848099:0:10902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 01:37:27 EDT 2026 00000100:00100000:0.0:1790919447.964656:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919447.964678:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978165760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919447.964744:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919447.964808:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165760 00000100:00100000:0.0:1790919447.964816:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165760 00000100:00100000:0.0:1790919447.964863:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919447.964882:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978165760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919447.964917:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919447.964960:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978165760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919447.964967:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1790919447.964989:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919447.965016:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843ea680 x1877914978165760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919447.965035:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978165760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919447.966642:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919447.968362:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978165888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919447.968456:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919447.970782:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919447.974732:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978165888 00000100:00100000:1.0:1790919447.974747:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978165888 00000100:00100000:0.0:1790919447.983837:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919447.983851:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978165888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919447.983878:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919447.983953:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978165888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (15498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919447.983960:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790919447.984008:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a01c00 x1877914978165888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919447.984028:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978165888:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790919447.984141:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790919448.989708:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919449.042940:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919449.042981:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919449.043014:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919449.043042:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178048 00000100:00100000:0.0:1790919449.043086:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178048 00000100:00100000:3.0:1790919449.043260:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177920 00000100:00100000:3.0:1790919449.043265:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177920 00000100:00100000:3.0:1790919449.043330:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:3.0:1790919449.043347:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958177920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919449.043433:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958177920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 94us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919449.043441:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00080000:3.0:1790919449.043464:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919449.043633:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958177792 00000100:00100000:2.0:1790919449.043645:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958177792 00000100:00100000:2.0:1790919449.043682:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00100000:2.0:1790919449.043690:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958177792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919449.043727:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958177792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.043733:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00100000:0.0:1790919449.044155:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:0.0:1790919449.044164:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958178048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919449.044208:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958178048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919449.044216:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00080000:3.0:1790919449.045524:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919449.501156:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978166016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919449.501256:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919449.501354:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166016 00000100:00100000:2.0:1790919449.501365:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166016 00000100:00100000:2.0:1790919449.501433:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919449.501445:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978166016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919449.501502:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790919449.501507:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919449.501551:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978166016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.501560:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919449.501585:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978166144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919449.501611:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919449.501628:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978166656:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.501631:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978166272:0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.501653:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.501666:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.501690:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978166784:0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.501693:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978167168:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.501715:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919449.501716:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919449.501734:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978167680:0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.501766:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919449.501785:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790919449.501811:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978166528:0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.501838:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919449.501856:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978167040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.501886:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166656 00000100:00100000:2.0:1790919449.501890:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166656 00000100:00100000:2.0:1790919449.501916:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166528 00000100:00100000:2.0:1790919449.501919:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166528 00000100:00100000:2.0:1790919449.501931:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790919449.501936:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978166656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.501984:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978166656:12345-0@lo:400:kworker.0 Request processed in 47us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.501990:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790919449.502002:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919449.502008:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978166528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.502037:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978166528:12345-0@lo:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.502043:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919449.502091:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166272 00000100:00100000:2.0:1790919449.502095:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166272 00000100:00100000:2.0:1790919449.502120:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790919449.502127:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978166272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.502159:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978166272:12345-0@lo:400:kworker.0 Request processed in 32us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.502165:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790919449.502195:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167168 00000100:00100000:2.0:1790919449.502198:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167168 00000100:00100000:2.0:1790919449.502232:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167680 00000100:00100000:2.0:1790919449.502243:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167680 00000100:00100000:2.0:1790919449.502266:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790919449.502272:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978167168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.502302:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978167168:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.502307:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790919449.502318:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919449.502323:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978167680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919449.502353:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978167680:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919449.502359:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1790919449.502395:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919449.502399:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790919449.502429:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b59a5180 x1877914978166016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919449.502452:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978166016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919449.504225:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166144 00000100:00100000:0.0:1790919449.504244:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166144 00000100:00100000:0.0:1790919449.504310:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790919449.504319:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978166144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919449.504348:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919449.504442:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978166144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919449.504450:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790919449.509492:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.509534:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978167552:0@lo:400:kworker.0 00000100:00100000:3.0:1790919449.510269:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166784 00000100:00100000:3.0:1790919449.510283:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166784 00000100:00100000:3.0:1790919449.510347:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167040 00000100:00100000:3.0:1790919449.510350:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167040 00000100:00100000:3.0:1790919449.510391:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790919449.510403:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978166784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.511247:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790919449.511343:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a02680 x1877914978167168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919449.511363:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978167168:0@lo:400:kworker.0 00010000:00080000:1.0:1790919449.511380:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edc380 x1877914978167680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919449.511389:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978167680:0@lo:400:kworker.0 00010000:00080000:1.0:1790919449.511401:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a03100 x1877914978166144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919449.511420:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978166144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919449.511432:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978166656:0@lo:400:kworker.0 00000100:00100000:3.0:1790919449.511829:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978166784:12345-0@lo:400:kworker.0 Request processed in 1425us (10109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919449.511841:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790919449.513226:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978166528:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.513356:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167552 00000100:00100000:1.0:1790919449.513365:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167552 00000100:00100000:1.0:1790919449.513417:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790919449.513428:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.513538:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978167040:12345-0@lo:400:kworker.0 Request processed in 112us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919449.513545:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790919449.513562:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790919449.513568:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978167552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.513601:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978167552:12345-0@lo:400:kworker.0 Request processed in 33us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919449.513607:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1790919449.513645:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a03b80 x1877914978167040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919449.513657:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978167040:0@lo:400:kworker.0 00010000:00080000:1.0:1790919449.513669:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edca80 x1877914978167552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919449.513678:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978167552:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.513719:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978166784:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.513734:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978167296:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515133:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.515207:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167296 00000100:00100000:1.0:1790919449.515217:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167296 00000100:00100000:1.0:1790919449.515275:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919449.515296:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978167296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515354:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978167296:12345-0@lo:400:kworker.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919449.515362:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1790919449.515408:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5ede300 x1877914978167296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919449.515422:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978167296:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515472:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978166272:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515484:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790919449.515494:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978166400:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515525:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.515549:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166400 00000100:00100000:1.0:1790919449.515553:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166400 00000100:00100000:1.0:1790919449.515575:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919449.515581:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978166400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515613:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978166400:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919449.515619:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919449.515643:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978166400:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515651:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978166912:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515672:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.515688:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978166912 00000100:00100000:1.0:1790919449.515691:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978166912 00000100:00100000:1.0:1790919449.515709:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790919449.515714:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978166912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515758:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978166912:12345-0@lo:400:kworker.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919449.515764:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790919449.515786:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978166912:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515793:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978167424:0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.515813:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919449.515829:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167424 00000100:00100000:1.0:1790919449.515832:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167424 00000100:00100000:1.0:1790919449.515848:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790919449.515853:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978167424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919449.518612:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978167424:12345-0@lo:400:kworker.0 Request processed in 2752us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919449.518689:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1790919449.518981:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919449.519214:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919449.519218:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919449.519842:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978167424:0@lo:400:kworker.0 00010000:00010000:1.0:1790919450.018598:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919451.036214:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919452.069358:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919452.572357:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919452.572380:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978167808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919452.572449:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919452.572544:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167808 00000100:00100000:0.0:1790919452.572553:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167808 00000100:00100000:0.0:1790919452.572606:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790919452.572616:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978167808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919452.572655:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919452.572705:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978167808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919452.572713:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790919452.572760:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978167808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919452.577385:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919452.577406:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978167936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919452.577471:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919452.577528:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978167936 00000100:00100000:0.0:1790919452.577543:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978167936 00000100:00100000:0.0:1790919452.577584:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790919452.577592:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978167936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919452.577628:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919452.577673:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978167936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919452.577680:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790919452.577724:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978167936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919453.084703:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978168192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919453.084793:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919453.084866:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919453.084873:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978168064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919453.084906:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919453.085191:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168192 00000100:00100000:1.0:1790919453.085201:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168192 00000100:00100000:1.0:1790919453.085253:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168064 00000100:00100000:1.0:1790919453.085256:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168064 00000100:00100000:1.0:1790919453.085274:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919453.085282:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978168192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919453.085331:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919453.085383:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978168192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919453.085389:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919453.085414:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790919453.085420:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978168064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919453.085551:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919453.085580:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978168064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919453.085587:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1790919453.085606:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919453.085640:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843e8e00 x1877914978168064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919453.085660:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978168064:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790919453.085672:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed86300 x1877914978168192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919453.085683:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978168192:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790919453.086359:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919454.108236:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919454.153279:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919454.153637:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919454.153678:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919454.153916:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178176 00000100:00100000:0.0:1790919454.153929:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178176 00000100:00100000:0.0:1790919454.153994:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 282 00000100:00100000:0.0:1790919454.154005:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958178176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919454.154130:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958178176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 125us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919454.154139:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 282 00000100:00100000:1.0:1790919454.171621:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178304 00000100:00100000:1.0:1790919454.171644:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178304 00000100:00100000:1.0:1790919454.171739:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178432 00000100:00100000:1.0:1790919454.171744:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178432 00000100:00100000:1.0:1790919454.171777:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1790919454.171790:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958178304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919454.172638:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958178304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 845us (19373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.172649:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1790919454.172682:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1790919454.172692:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958178432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919454.172731:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958178432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (19052us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.172756:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00080000:1.0:1790919454.172787:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919454.172792:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919454.620677:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978168704:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.620773:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919454.620846:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978169216:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.620873:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919454.620893:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978169728:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.620916:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919454.620943:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790919454.620950:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978168576:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.620972:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919454.620990:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978169088:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621015:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919454.621046:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978169600:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621093:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919454.621129:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168704 00000100:00100000:1.0:1790919454.621140:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168704 00000100:00100000:1.0:1790919454.621194:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790919454.621205:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978168704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621276:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978168704:12345-0@lo:400:kworker.0 Request processed in 72us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.621283:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790919454.621311:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169216 00000100:00100000:1.0:1790919454.621315:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169216 00000100:00100000:1.0:1790919454.621366:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169728 00000100:00100000:1.0:1790919454.621370:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169728 00000100:00100000:1.0:1790919454.621383:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168576 00000100:00100000:1.0:1790919454.621385:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168576 00000100:00100000:1.0:1790919454.621396:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169088 00000100:00100000:1.0:1790919454.621398:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169088 00000100:00100000:1.0:1790919454.621410:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169600 00000100:00100000:1.0:1790919454.621412:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169600 00000100:00100000:1.0:1790919454.621430:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790919454.621436:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621470:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978169216:12345-0@lo:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.621477:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790919454.621490:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790919454.621496:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978169728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621524:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978169728:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.621530:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790919454.621542:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919454.621548:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978168576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621579:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978168576:12345-0@lo:400:kworker.0 Request processed in 31us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.621584:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919454.621595:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919454.621602:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978169088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621629:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978169088:12345-0@lo:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.621646:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919454.621659:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919454.621664:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621695:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978169600:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.621701:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1790919454.621732:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919454.621737:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919454.621771:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978168576:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621783:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978169088:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621793:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978169600:0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.621801:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978168704:0@lo:400:kworker.0 00010000:00080000:1.0:1790919454.621814:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed86680 x1877914978169216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919454.621824:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978169216:0@lo:400:kworker.0 00010000:00080000:1.0:1790919454.621834:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed84700 x1877914978169728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919454.621842:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978169728:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.621951:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978168448:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.621990:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622034:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978168960:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622079:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622099:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978169472:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622124:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622142:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978169984:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622175:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622196:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1790919454.622203:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978168320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919454.622228:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622249:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978168832:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622271:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622287:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978169344:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622308:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622327:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978169856:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622348:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919454.622384:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169472 00000100:00100000:2.0:1790919454.622390:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169472 00000100:00100000:2.0:1790919454.622417:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169984 00000100:00100000:2.0:1790919454.622420:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169984 00000100:00100000:2.0:1790919454.622439:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169344 00000100:00100000:2.0:1790919454.622442:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169344 00000100:00100000:2.0:1790919454.622454:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978169856 00000100:00100000:2.0:1790919454.622457:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978169856 00000100:00100000:2.0:1790919454.622471:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919454.622478:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978169472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622521:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978169472:12345-0@lo:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919454.622528:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919454.622542:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919454.622547:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978169984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622575:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978169984:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919454.622590:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919454.622602:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919454.622607:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978169344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622637:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978169344:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919454.622643:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919454.622653:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919454.622658:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978169856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622684:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978169856:12345-0@lo:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919454.622689:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919454.622709:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168320 00000100:00100000:2.0:1790919454.622712:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168320 00000100:00100000:2.0:1790919454.622735:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790919454.622742:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978168320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919454.622775:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919454.622805:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978168320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919454.622811:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1790919454.622835:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919454.622844:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168960 00000100:00100000:2.0:1790919454.622847:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168960 00000100:00100000:2.0:1790919454.622871:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790919454.622876:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978168960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.622903:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978168960:12345-0@lo:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919454.622915:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1790919454.622948:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed86300 x1877914978168320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919454.622966:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978168320:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790919454.622976:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed85500 x1877914978169344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919454.622984:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978169344:0@lo:400:kworker.0 00010000:00080000:2.0:1790919454.622993:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed85f80 x1877914978169856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919454.623000:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978169856:0@lo:400:kworker.0 00000100:00100000:2.0:1790919454.623011:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978168960:0@lo:400:kworker.0 00010000:00080000:2.0:1790919454.623032:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed84380 x1877914978169472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919454.623040:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978169472:0@lo:400:kworker.0 00010000:00080000:2.0:1790919454.623073:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5edd880 x1877914978169984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919454.623082:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978169984:0@lo:400:kworker.0 00000100:00100000:0.0:1790919454.623299:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168832 00000100:00100000:0.0:1790919454.623305:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168832 00000100:00100000:0.0:1790919454.623336:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919454.623343:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978168832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919454.623389:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978168832:12345-0@lo:400:kworker.0 Request processed in 46us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919454.623395:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919454.624402:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919454.624425:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978170112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919454.624481:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919454.624524:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170112 00000100:00100000:0.0:1790919454.624545:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170112 00000100:00100000:0.0:1790919454.624578:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790919454.624587:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978170112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919454.624608:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919454.624648:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978170112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919454.624655:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790919454.624696:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978168832:0@lo:400:kworker.0 00010000:00080000:0.0:1790919454.624760:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843eb480 x1877914978170112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919454.624774:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978170112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919454.625080:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978168448 00000100:00100000:1.0:1790919454.625086:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978168448 00000100:00100000:1.0:1790919454.625118:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790919454.625126:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978168448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919454.625188:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978168448:12345-0@lo:400:kworker.0 Request processed in 63us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919454.625195:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1790919454.625743:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978168448:0@lo:400:kworker.0 00010000:00010000:0.0:1790919455.133498:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919456.156290:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919457.181171:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919457.695176:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919457.695197:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978170240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919457.695261:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919457.695336:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170240 00000100:00100000:1.0:1790919457.695346:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170240 00000100:00100000:1.0:1790919457.695401:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790919457.695411:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978170240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919457.695450:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919457.695507:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978170240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919457.695514:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919457.695554:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978170240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919457.698103:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978170368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919457.698191:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919457.700112:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170368 00000100:00100000:3.0:1790919457.700126:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170368 00000100:00100000:3.0:1790919457.700435:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790919457.700447:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978170368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919457.700494:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919457.700642:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978170368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 197us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919457.700651:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919457.700726:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978170368:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790919458.204260:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919458.204370:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978170496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919458.204616:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919458.204751:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170496 00000100:00100000:1.0:1790919458.204759:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170496 00000100:00100000:1.0:1790919458.204834:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919458.204846:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978170496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919458.204884:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919458.204935:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978170496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919458.204943:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790919458.205067:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790919458.205094:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a03b80 x1877914978170496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919458.205111:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978170496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919458.211139:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919458.211162:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978170624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919458.211234:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919458.213268:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170624 00000100:00100000:3.0:1790919458.213281:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170624 00000100:00100000:3.0:1790919458.213350:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790919458.213362:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978170624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919458.213387:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919458.213458:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978170624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919458.213464:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1790919458.213491:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919458.213631:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a01f80 x1877914978170624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919458.213668:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978170624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790919459.228203:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919459.276775:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919459.276839:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919459.276864:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919459.276889:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178816 00000100:00100000:2.0:1790919459.276897:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178816 00000100:00100000:2.0:1790919459.276942:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178688 00000100:00100000:2.0:1790919459.276944:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178688 00000100:00100000:2.0:1790919459.276962:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1790919459.276971:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958178816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919459.277091:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958178816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 120us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.277099:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1790919459.277116:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:2.0:1790919459.277123:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958178688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919459.277150:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958178688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.277155:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00080000:2.0:1790919459.277169:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919459.277173:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919459.278489:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178560 00000100:00100000:3.0:1790919459.278504:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178560 00000100:00100000:3.0:1790919459.278582:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 284 00000100:00100000:3.0:1790919459.278591:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958178560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919459.278639:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:2412:x1877914958178560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 49us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919459.278646:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 284 00000100:00100000:2.0:1790919459.740358:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978170752:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740437:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740488:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978171264:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740514:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740534:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978171776:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740557:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740574:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978172288:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740598:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740622:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790919459.740628:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978171136:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740651:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740669:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978171648:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740691:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740707:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978172160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740738:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740778:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978170880:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740802:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740821:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978171392:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740842:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740859:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978171904:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740879:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740896:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790919459.740901:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978171008:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740919:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740933:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978171520:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.740961:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.740977:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978172032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741007:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.741040:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171264 00000100:00100000:2.0:1790919459.741048:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171264 00000100:00100000:2.0:1790919459.741128:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170880 00000100:00100000:2.0:1790919459.741132:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170880 00000100:00100000:2.0:1790919459.741143:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171392 00000100:00100000:2.0:1790919459.741145:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171392 00000100:00100000:2.0:1790919459.741167:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171904 00000100:00100000:2.0:1790919459.741170:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171904 00000100:00100000:2.0:1790919459.741182:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171520 00000100:00100000:2.0:1790919459.741185:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171520 00000100:00100000:2.0:1790919459.741197:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172032 00000100:00100000:2.0:1790919459.741199:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172032 00000100:00100000:2.0:1790919459.741213:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919459.741220:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978171264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741271:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978171264:12345-0@lo:400:kworker.0 Request processed in 51us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741278:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919459.741296:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790919459.741301:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741332:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978170880:12345-0@lo:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741338:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790919459.741350:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790919459.741356:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978171392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741384:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978171392:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741396:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790919459.741408:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790919459.741414:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978171904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741442:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978171904:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741448:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790919459.741459:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919459.741465:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978171520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741494:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978171520:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741499:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919459.741510:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790919459.741516:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978172032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741542:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978172032:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741548:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790919459.741566:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171776 00000100:00100000:2.0:1790919459.741570:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171776 00000100:00100000:2.0:1790919459.741586:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172288 00000100:00100000:2.0:1790919459.741589:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172288 00000100:00100000:2.0:1790919459.741600:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171648 00000100:00100000:2.0:1790919459.741602:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171648 00000100:00100000:2.0:1790919459.741612:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172160 00000100:00100000:2.0:1790919459.741613:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172160 00000100:00100000:2.0:1790919459.741624:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919459.741630:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978171776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741671:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978171776:12345-0@lo:400:kworker.0 Request processed in 41us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741677:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919459.741689:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790919459.741695:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978172288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741722:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978172288:12345-0@lo:400:kworker.0 Request processed in 28us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741729:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790919459.741739:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790919459.741745:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978171648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741772:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978171648:12345-0@lo:400:kworker.0 Request processed in 27us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741778:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790919459.741789:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790919459.741796:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978172160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741823:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978172160:12345-0@lo:400:kworker.0 Request processed in 27us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741828:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790919459.741854:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171136 00000100:00100000:2.0:1790919459.741858:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171136 00000100:00100000:2.0:1790919459.741882:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978171008 00000100:00100000:2.0:1790919459.741884:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978171008 00000100:00100000:2.0:1790919459.741895:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790919459.741901:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978171136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.741934:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978171136:12345-0@lo:400:kworker.0 Request processed in 33us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.741949:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790919459.741961:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790919459.741967:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978171008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.742021:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978171008:12345-0@lo:400:kworker.0 Request processed in 54us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919459.742027:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1790919459.742117:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919459.742122:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919459.742124:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919459.742133:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919459.742143:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978172416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919459.742174:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919459.742220:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978171008:0@lo:400:kworker.0 00010000:00080000:2.0:1790919459.742233:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed84380 x1877914978171520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919459.742243:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978171520:0@lo:400:kworker.0 00010000:00080000:2.0:1790919459.742254:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed86300 x1877914978172032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919459.742262:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978172032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.742271:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978170880:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.742280:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978171392:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.742291:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978171904:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.742328:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978171136:0@lo:400:kworker.0 00010000:00080000:2.0:1790919459.742348:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed87100 x1877914978171648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919459.742358:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978171648:0@lo:400:kworker.0 00010000:00080000:2.0:1790919459.742367:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed84700 x1877914978172160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919459.742375:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978172160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919459.742384:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978171264:0@lo:400:kworker.0 00010000:00080000:2.0:1790919459.742394:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed85f80 x1877914978171776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919459.742401:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978171776:0@lo:400:kworker.0 00010000:00080000:2.0:1790919459.742408:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed86680 x1877914978172288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919459.742415:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978172288:0@lo:400:kworker.0 00000100:00100000:3.0:1790919459.742764:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172416 00000100:00100000:3.0:1790919459.742770:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172416 00000100:00100000:3.0:1790919459.742805:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919459.742812:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978172416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919459.742839:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919459.742882:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978172416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919459.742889:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1790919459.742918:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a19880 x1877914978172416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919459.742932:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978172416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919459.743862:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978170752 00000100:00100000:1.0:1790919459.743870:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978170752 00000100:00100000:1.0:1790919459.743903:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790919459.743911:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978170752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919459.743966:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978170752:12345-0@lo:400:kworker.0 Request processed in 56us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919459.743973:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790919459.744024:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978170752:0@lo:400:kworker.0 00000100:00100000:3.0:1790919459.744316:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978172544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919459.744354:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919459.744390:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172544 00000100:00100000:3.0:1790919459.744395:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172544 00000100:00100000:3.0:1790919459.744426:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790919459.744433:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978172544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919459.744448:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919459.744484:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978172544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919459.744497:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1790919459.744530:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843eb480 x1877914978172544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919459.744546:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978172544:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790919460.252164:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919461.276361:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919462.301184:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919462.401538:0:11531:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:37:41 (1790919461) === 00000100:00100000:2.0:1790919462.791498:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.791652:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958178944 00000100:00100000:3.0:1790919462.791663:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958178944 00000100:00100000:3.0:1790919462.791721:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 286 00000100:00100000:3.0:1790919462.791730:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+10:8954:x1877914958178944:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790919462.791754:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919462.791773:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c400/0x951c50ad159136e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b28 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919462.791798:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c400/0x951c50ad159136e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b28 expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919462.791809:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c400/0x951c50ad159136e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b28 expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919462.791817:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c400, rc 0) 00000100:00100000:3.0:1790919462.791873:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:8954:x1877914958178944:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.791879:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 286 00000100:00100000:3.0:1790919462.794666:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.794815:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179072 00000100:00100000:1.0:1790919462.794824:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179072 00000100:00100000:0.0:1790919462.794966:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:0.0:1790919462.794978:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+11:8954:x1877914958179072:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790919462.795323:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+11:8954:x1877914958179072:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 347us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919462.795331:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:2.0:1790919462.801339:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.808918:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179200 00000100:00100000:3.0:1790919462.809496:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179200 00000100:00100000:3.0:1790919462.809628:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:3.0:1790919462.809648:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:8954:x1877914958179200:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790919462.809878:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:8954:x1877914958179200:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 240us (8546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.809886:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:1.0:1790919462.812206:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978172672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919462.812280:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919462.812467:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172672 00000100:00100000:3.0:1790919462.812475:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172672 00000100:00100000:3.0:1790919462.812526:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790919462.812534:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978172672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919462.812569:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919462.812615:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978172672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.812622:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790919462.812661:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978172672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919462.813416:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.813487:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179328 00000100:00100000:1.0:1790919462.813492:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179328 00000100:00100000:1.0:1790919462.813517:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:3.0:1790919462.813518:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919462.813524:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+11:8958:x1877914958179328:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919462.813526:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978172800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919462.813557:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919462.813589:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172800 00000100:00100000:3.0:1790919462.813592:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172800 00000100:00100000:3.0:1790919462.813616:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919462.813622:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978172800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919462.813644:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919462.813676:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978172800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.813682:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919462.813712:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978172800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919462.813788:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+11:8958:x1877914958179328:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 262us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.813795:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:1.0:1790919462.856236:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.856378:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179456 00000100:00100000:3.0:1790919462.856390:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179456 00000100:00100000:3.0:1790919462.856447:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:3.0:1790919462.856456:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:8958:x1877914958179456:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919462.856695:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:8958:x1877914958179456:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 239us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.856702:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:2.0:1790919462.860882:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919462.861093:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179584 00000100:00100000:0.0:1790919462.861104:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179584 00000100:00100000:0.0:1790919462.861155:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:0.0:1790919462.861164:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+11:8958:x1877914958179584:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919462.861389:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+11:8958:x1877914958179584:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 225us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919462.861407:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:2.0:1790919462.869878:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.869984:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179712 00000100:00100000:1.0:1790919462.869994:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179712 00000100:00100000:1.0:1790919462.870226:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:1.0:1790919462.870237:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+11:8954:x1877914958179712:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919462.870268:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919462.870288:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6486600/0x951c50ad159136ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b59 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919462.870317:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6486600/0x951c50ad159136ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b59 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919462.870329:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6486600/0x951c50ad159136ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b59 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919462.870338:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486600, rc 0) 00000100:00100000:1.0:1790919462.870398:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+12:8954:x1877914958179712:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 162us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.870405:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:1.0:1790919462.874728:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.874818:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179840 00000100:00100000:3.0:1790919462.874828:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179840 00000100:00100000:3.0:1790919462.874887:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:3.0:1790919462.874896:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:8954:x1877914958179840:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790919462.874923:0:6440:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790919462.874947:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790919462.874951:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790919462.874954:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790919462.874965:0:6440:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790919462.874968:0:6440:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1790919462.879103:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:8954:x1877914958179840:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 4198us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.879117:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:2.0:1790919462.882976:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.883136:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958179968 00000100:00100000:1.0:1790919462.883146:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958179968 00000100:00100000:1.0:1790919462.883199:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:1.0:1790919462.883208:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+12:8954:x1877914958179968:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919462.883225:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919462.883243:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b60 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919462.883276:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 13 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919462.883287:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 13 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919462.883314:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487e00, rc 0) 00000100:00100000:1.0:1790919462.883380:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:8954:x1877914958179968:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 172us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.883387:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:1.0:1790919462.888827:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.888915:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180096 00000100:00100000:3.0:1790919462.888925:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180096 00000100:00100000:3.0:1790919462.888986:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:3.0:1790919462.888996:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:8954:x1877914958180096:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790919462.889316:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:8954:x1877914958180096:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 320us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.889334:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:2.0:1790919462.893860:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919462.894079:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180224 00000100:00100000:0.0:1790919462.894089:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180224 00000100:00100000:0.0:1790919462.894150:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:0.0:1790919462.894160:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:8954:x1877914958180224:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919462.894386:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:8954:x1877914958180224:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 227us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919462.894393:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:2.0:1790919462.898891:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.898997:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180352 00000100:00100000:1.0:1790919462.899006:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180352 00000100:00100000:1.0:1790919462.899098:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:1.0:1790919462.899107:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:8963:x1877914958180352:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919462.899357:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:8963:x1877914958180352:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 250us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.899369:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:1.0:1790919462.902249:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.902324:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180480 00000100:00100000:3.0:1790919462.902334:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180480 00000100:00100000:3.0:1790919462.902398:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:3.0:1790919462.902408:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:8963:x1877914958180480:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919462.902638:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:8963:x1877914958180480:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 231us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.902646:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:2.0:1790919462.906109:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919462.906153:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.906250:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180736 00000100:00100000:1.0:1790919462.906260:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180736 00000100:00100000:1.0:1790919462.906324:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180864 00000100:00100000:1.0:1790919462.906327:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180864 00000100:00100000:1.0:1790919462.906349:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:1.0:1790919462.906358:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958180736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919462.906367:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1790919462.906381:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958180864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919462.906430:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958180864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.906437:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00080000:2.0:1790919462.906488:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919462.906492:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919462.906803:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958180736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 445us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.906810:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1790919462.908321:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919462.908791:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919462.910395:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180608 00000100:00100000:0.0:1790919462.910411:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180608 00000100:00100000:0.0:1790919462.910468:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181120 00000100:00100000:0.0:1790919462.910472:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181120 00000100:00100000:0.0:1790919462.910505:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790919462.910513:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2410:x1877914958180608:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790919462.910544:0:10757:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a0eadf68-44c6-442a-b15d-9a125194f9a5@192.168.203.11@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:0.0:1790919462.910584:0:10757:0:(genops.c:1384:class_connect()) connect: client a0eadf68-44c6-442a-b15d-9a125194f9a5, cookie 0x951c50ad159136fa 00000004:00100000:0.0:1790919462.910614:0:10757:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790919462.910866:0:10757:0:(import.c:65:import_set_state_nolock()) ffff95f3a6bac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919462.911104:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919462.911111:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1877914958181120:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790919462.911128:0:6445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a0eadf68-44c6-442a-b15d-9a125194f9a5@192.168.203.11@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1790919462.911151:0:6445:0:(genops.c:1384:class_connect()) connect: client a0eadf68-44c6-442a-b15d-9a125194f9a5, cookie 0x951c50ad15913701 00000004:00100000:2.0:1790919462.911167:0:6445:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790919462.911330:0:6445:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919462.911368:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2410:x1877914958181120:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 255us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919462.911376:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790919462.911685:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2410:x1877914958180608:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 414us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919462.911693:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790919462.915237:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.919909:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181248 00000100:00100000:1.0:1790919462.920000:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181248 00000100:00100000:2.0:1790919462.920397:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.920686:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958180992 00000100:00100000:3.0:1790919462.920691:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958180992 00000100:00100000:1.0:1790919462.926510:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790919462.926542:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:0:x1877914958181248:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790919462.926578:0:6447:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919462.926593:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1790919462.926601:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:0:x1877914958180992:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790919462.926614:0:6445:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1790919462.927409:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919462.927415:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919462.927534:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:0:x1877914958181248:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 993us (12302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.927544:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790919462.933655:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:0:x1877914958180992:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 7043us (13249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.933669:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919462.933731:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919462.935022:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181376 00000100:00100000:3.0:1790919462.935035:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181376 00000100:00100000:3.0:1790919462.935121:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1790919462.935145:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958181376:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790919462.935177:0:6446:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919462.935294:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958181376:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 150us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919462.935310:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919462.940123:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.940276:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181504 00000100:00100000:1.0:1790919462.940285:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181504 00000100:00100000:1.0:1790919462.940355:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790919462.940365:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958181504:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790919462.940452:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958181504:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.940460:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790919462.958205:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919462.958612:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181632 00000100:00100000:0.0:1790919462.958622:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181632 00000100:00100000:0.0:1790919462.958670:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790919462.958679:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958181632:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790919462.958726:0:8248:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a0eadf68-44c6-442a-b15d-9a125194f9a5@192.168.203.11@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:0.0:1790919462.958756:0:8248:0:(genops.c:1384:class_connect()) connect: client a0eadf68-44c6-442a-b15d-9a125194f9a5, cookie 0x951c50ad15913708 00002000:00100000:0.0:1790919462.958768:0:8248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a0eadf68-44c6-442a-b15d-9a125194f9a5/ffff95f3a6bae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790919462.958791:0:8248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790919462.959030:0:8248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919462.959079:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f3a6baf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919462.959153:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2410:x1877914958181632:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 472us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919462.959160:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790919462.959206:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.959259:0:6456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181888 00000100:00100000:1.0:1790919462.959264:0:6456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181888 00000100:00100000:0.0:1790919462.959321:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.959365:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790919462.959377:0:6456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958181888:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790919462.959426:0:6456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958181888:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.959433:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790919462.960261:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958181760 00000100:00100000:2.0:1790919462.960269:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958181760 00000100:00100000:2.0:1790919462.960316:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790919462.960323:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2410:x1877914958181760:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790919462.960357:0:8084:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a0eadf68-44c6-442a-b15d-9a125194f9a5@192.168.203.11@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1790919462.960380:0:8084:0:(genops.c:1384:class_connect()) connect: client a0eadf68-44c6-442a-b15d-9a125194f9a5, cookie 0x951c50ad1591370f 00002000:00100000:2.0:1790919462.960388:0:8084:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a0eadf68-44c6-442a-b15d-9a125194f9a5/ffff95f3b65b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919462.960405:0:8084:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919462.960584:0:8084:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790919462.960840:0:8084:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919462.960940:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2410:x1877914958181760:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 615us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919462.960948:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790919462.965083:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919462.965242:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182016 00000100:00100000:1.0:1790919462.965252:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182016 00000100:00100000:1.0:1790919462.965466:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1790919462.965478:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958182016:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790919462.965551:0:6448:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790919462.965632:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:8954:x1877914958182016:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 156us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919462.965654:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1790919463.324524:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1790919463.324869:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919463.327807:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978173056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919463.328371:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919463.328516:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978172928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919463.328543:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919463.328640:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173056 00000100:00100000:1.0:1790919463.328650:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173056 00000100:00100000:1.0:1790919463.328727:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978172928 00000100:00100000:1.0:1790919463.328731:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978172928 00000100:00100000:1.0:1790919463.328751:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919463.328761:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978173056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919463.328783:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919463.328835:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978173056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919463.328842:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919463.328857:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790919463.328863:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978172928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919463.328873:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919463.328896:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978172928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919463.328902:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1790919463.328988:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919463.329254:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843eaa00 x1877914978173056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919463.329273:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978173056:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1790919463.329284:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed84000 x1877914978172928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919463.329299:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978172928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790919464.349833:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919464.860426:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978173312:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860494:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860541:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978173824:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860563:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860583:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978174336:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860601:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860625:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790919464.860631:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978173184:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860659:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860680:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978173696:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860704:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860720:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978174208:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860757:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860774:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978174720:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860795:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860818:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978173568:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860839:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860856:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978174080:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860877:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860894:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978174592:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860930:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.860957:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790919464.860964:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978173440:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.860986:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.861005:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978173952:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861027:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.861044:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978174464:0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861092:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919464.861122:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173312 00000100:00100000:0.0:1790919464.861130:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173312 00000100:00100000:0.0:1790919464.861166:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173824 00000100:00100000:0.0:1790919464.861169:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173824 00000100:00100000:0.0:1790919464.861190:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174336 00000100:00100000:0.0:1790919464.861192:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174336 00000100:00100000:0.0:1790919464.861204:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173696 00000100:00100000:0.0:1790919464.861207:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173696 00000100:00100000:0.0:1790919464.861216:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173952 00000100:00100000:0.0:1790919464.861219:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173952 00000100:00100000:0.0:1790919464.861232:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174464 00000100:00100000:0.0:1790919464.861242:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174464 00000100:00100000:0.0:1790919464.861263:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790919464.861271:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978173312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861324:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978173312:12345-0@lo:400:kworker.0 Request processed in 54us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861331:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790919464.861354:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790919464.861360:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978173824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861390:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978173824:12345-0@lo:400:kworker.0 Request processed in 30us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861396:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790919464.861407:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790919464.861413:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978174336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861442:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978174336:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861448:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790919464.861461:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919464.861466:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861496:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978173696:12345-0@lo:400:kworker.0 Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861502:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919464.861513:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919464.861519:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978173952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861556:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978173952:12345-0@lo:400:kworker.0 Request processed in 37us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861572:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919464.861585:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919464.861592:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978174464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861622:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978174464:12345-0@lo:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861627:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919464.861653:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173184 00000100:00100000:0.0:1790919464.861657:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173184 00000100:00100000:0.0:1790919464.861689:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790919464.861698:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978173184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861729:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978173184:12345-0@lo:400:kworker.0 Request processed in 34us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861734:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790919464.861764:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174208 00000100:00100000:0.0:1790919464.861767:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174208 00000100:00100000:0.0:1790919464.861781:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174720 00000100:00100000:0.0:1790919464.861783:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174720 00000100:00100000:0.0:1790919464.861793:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174080 00000100:00100000:0.0:1790919464.861795:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174080 00000100:00100000:0.0:1790919464.861803:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174592 00000100:00100000:0.0:1790919464.861805:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174592 00000100:00100000:0.0:1790919464.861815:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919464.861820:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978174208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861847:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978174208:12345-0@lo:400:kworker.0 Request processed in 27us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861853:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919464.861864:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790919464.861874:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978174720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861902:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978174720:12345-0@lo:400:kworker.0 Request processed in 28us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861907:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790919464.861917:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919464.861922:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978174080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.861960:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978174080:12345-0@lo:400:kworker.0 Request processed in 37us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.861966:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919464.861978:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919464.861986:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978174592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.862020:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978174592:12345-0@lo:400:kworker.0 Request processed in 35us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.862026:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919464.862075:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173568 00000100:00100000:0.0:1790919464.862079:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173568 00000100:00100000:0.0:1790919464.862108:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978173440 00000100:00100000:0.0:1790919464.862110:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978173440 00000100:00100000:0.0:1790919464.862128:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790919464.862134:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978173568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.862172:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978173568:12345-0@lo:400:kworker.0 Request processed in 39us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.862178:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790919464.862190:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790919464.862198:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978173440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919464.862229:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978173440:12345-0@lo:400:kworker.0 Request processed in 32us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919464.862243:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790919464.862648:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978173440:0@lo:400:kworker.0 00010000:00080000:0.0:1790919464.862668:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843ebb80 x1877914978173952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919464.862682:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978173952:0@lo:400:kworker.0 00000100:00080000:2.0:1790919464.862825:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919464.862831:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919464.862834:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919464.864030:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919464.864071:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978174848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919464.864132:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919464.864215:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174848 00000100:00100000:1.0:1790919464.864222:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174848 00000100:00100000:1.0:1790919464.864264:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790919464.864273:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978174848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919464.864306:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919464.864350:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978174848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919464.864365:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1790919464.864599:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bdf0ad80 x1877914978174848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.864618:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978174848:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1790919464.864689:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c30a80 x1877914978174464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.864699:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978174464:0@lo:400:kworker.0 00000100:00100000:1.0:1790919464.864711:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978173568:0@lo:400:kworker.0 00010000:00080000:1.0:1790919464.864723:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d548700 x1877914978174080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.864731:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978174080:0@lo:400:kworker.0 00010000:00080000:1.0:1790919464.864740:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32680 x1877914978174592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.864747:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978174592:0@lo:400:kworker.0 00000100:00100000:1.0:1790919464.864771:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919464.864778:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978174976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919464.864806:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919464.864834:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978174976 00000100:00100000:1.0:1790919464.864838:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978174976 00000100:00100000:1.0:1790919464.864864:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790919464.864871:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978174976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919464.864882:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919464.864923:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978174976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919464.864929:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790919464.864974:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978173184:0@lo:400:kworker.0 00000100:00100000:1.0:1790919464.864988:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978173696:0@lo:400:kworker.0 00010000:00080000:1.0:1790919464.865001:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f391516a00 x1877914978174208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.865010:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978174208:0@lo:400:kworker.0 00010000:00080000:1.0:1790919464.865019:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32300 x1877914978174720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.865026:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978174720:0@lo:400:kworker.0 00000100:00100000:1.0:1790919464.865036:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978173312:0@lo:400:kworker.0 00000100:00100000:1.0:1790919464.865047:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978173824:0@lo:400:kworker.0 00000100:00100000:1.0:1790919464.865084:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978174336:0@lo:400:kworker.0 00010000:00080000:1.0:1790919464.865121:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a19880 x1877914978174976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919464.865132:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978174976:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1790919464.949974:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00000001:00100000:1.0:1790919465.001368:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00010000:00010000:2.0:1790919465.372223:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919466.396299:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790919466.956152:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00010000:00010000:2.0:1790919467.425655:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919467.699555:0:11729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1790919467.932544:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919467.932568:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978175104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919467.932687:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919467.932888:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bdf09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978175232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919467.932917:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919467.933000:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175104 00000100:00100000:3.0:1790919467.933008:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175104 00000100:00100000:3.0:1790919467.933078:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175232 00000100:00100000:3.0:1790919467.933081:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175232 00000100:00100000:3.0:1790919467.933098:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919467.933107:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978175104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919467.933146:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919467.933222:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978175104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919467.933230:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919467.933247:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919467.933254:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978175232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919467.933273:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919467.933320:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978175232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919467.933326:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919467.933362:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bdf09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978175232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919467.933387:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978175104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919467.978708:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978751:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978774:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978796:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978833:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978853:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978877:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919467.978902:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182400 00000100:00100000:1.0:1790919467.978932:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182400 00000100:00100000:1.0:1790919467.978981:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182656 00000100:00100000:1.0:1790919467.978984:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182656 00000100:00100000:1.0:1790919467.978998:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182272 00000100:00100000:1.0:1790919467.979001:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182272 00000100:00100000:1.0:1790919467.979012:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182528 00000100:00100000:1.0:1790919467.979015:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182528 00000100:00100000:3.0:1790919467.979108:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182144 00000100:00100000:3.0:1790919467.979113:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182144 00000100:00100000:3.0:1790919467.979153:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:3.0:1790919467.979163:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958182144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919467.979228:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958182144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919467.979235:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:1.0:1790919467.979706:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:1.0:1790919467.979714:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958182400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919467.979765:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958182400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 51us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919467.979774:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:1.0:1790919467.979795:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790919467.979803:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958182656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919467.979835:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958182656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919467.979842:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790919467.979863:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:1.0:1790919467.979872:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958182272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919467.980170:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958182272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 298us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919467.980180:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:1.0:1790919467.980210:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1790919467.980220:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958182528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919467.980252:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958182528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919467.980259:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1790919467.980293:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182912 00000100:00100000:1.0:1790919467.980298:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182912 00000100:00100000:1.0:1790919467.980350:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958182784 00000100:00100000:1.0:1790919467.980354:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958182784 00000100:00100000:1.0:1790919467.980388:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1790919467.980397:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2414:x1877914958182912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919467.980428:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2414:x1877914958182912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919467.980436:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1790919467.980456:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1790919467.980466:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958182784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919467.980495:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958182784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919467.980503:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00080000:1.0:1790919467.980542:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919467.980547:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919467.980550:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919467.980554:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1790919467.990287:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00000100:00100000:3.0:1790919468.444348:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978175360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919468.444440:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919468.444539:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175360 00000100:00100000:3.0:1790919468.444549:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175360 00000100:00100000:1.0:1790919468.444738:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919468.444749:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978175488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919468.444798:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919468.444828:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175488 00000100:00100000:1.0:1790919468.444831:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175488 00000100:00100000:1.0:1790919468.444861:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790919468.444871:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978175360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919468.444916:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919468.444975:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978175360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919468.444983:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790919468.445001:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919468.445008:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978175488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919468.445018:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919468.445046:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978175488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919468.445075:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1790919468.445115:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed85500 x1877914978175488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919468.445137:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978175488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919468.445502:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919468.445534:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bbfd6300 x1877914978175360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919468.445564:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978175360:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790919468.451976:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919469.469421:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919469.981386:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978175616:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.981454:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.981497:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978176128:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.981535:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.981555:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978176640:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.981581:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.981604:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790919469.981610:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978176000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.981632:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.981648:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978176512:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.981669:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.981697:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175616 00000100:00100000:0.0:1790919469.981704:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175616 00000100:00100000:0.0:1790919469.981740:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790919469.981748:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978175616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.981808:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978175616:12345-0@lo:400:kworker.0 Request processed in 60us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919469.981816:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790919469.981849:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176640 00000100:00100000:0.0:1790919469.981854:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176640 00000100:00100000:0.0:1790919469.981877:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176512 00000100:00100000:0.0:1790919469.981880:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176512 00000100:00100000:0.0:1790919469.981896:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790919469.981903:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978176640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.982012:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978176640:12345-0@lo:400:kworker.0 Request processed in 44us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919469.982021:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790919469.982034:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919469.982041:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.982093:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978176512:12345-0@lo:400:kworker.0 Request processed in 52us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919469.982099:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919469.982118:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176000 00000100:00100000:0.0:1790919469.982122:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176000 00000100:00100000:0.0:1790919469.982146:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790919469.982152:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.982182:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978176000:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919469.982189:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790919469.982234:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978176000:0@lo:400:kworker.0 00010000:00080000:0.0:1790919469.982247:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd8a80 x1877914978176512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919469.982263:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978176512:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.982273:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978175616:0@lo:400:kworker.0 00010000:00080000:0.0:1790919469.982283:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9880 x1877914978176640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919469.982291:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978176640:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982667:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978175744:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982703:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.982727:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978176256:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982748:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.982776:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978176768:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982800:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.982820:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790919469.982826:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978175872:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982850:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.982869:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978176384:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982890:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.982918:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978176896:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.982938:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.983029:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175872 00000100:00100000:2.0:1790919469.983035:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175872 00000100:00100000:2.0:1790919469.983083:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919469.983091:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978175872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.983134:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978175872:12345-0@lo:400:kworker.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.983140:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919469.983157:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176128 00000100:00100000:2.0:1790919469.983161:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176128 00000100:00100000:2.0:1790919469.983176:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978175744 00000100:00100000:2.0:1790919469.983179:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978175744 00000100:00100000:2.0:1790919469.983188:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176256 00000100:00100000:2.0:1790919469.983190:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176256 00000100:00100000:2.0:1790919469.983209:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176768 00000100:00100000:2.0:1790919469.983211:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176768 00000100:00100000:2.0:1790919469.983222:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176384 00000100:00100000:2.0:1790919469.983224:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176384 00000100:00100000:2.0:1790919469.983234:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978176896 00000100:00100000:2.0:1790919469.983236:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978176896 00000100:00100000:2.0:1790919469.983247:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790919469.983262:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.983293:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978176128:12345-0@lo:400:kworker.0 Request processed in 34us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.983299:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790919469.983408:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978177152:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.983436:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.983465:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978176128:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.983480:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919469.983484:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978177024:0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.983504:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919469.983527:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177152 00000100:00100000:0.0:1790919469.983530:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177152 00000100:00100000:0.0:1790919469.983550:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177024 00000100:00100000:0.0:1790919469.983553:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177024 00000100:00100000:0.0:1790919469.983569:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919469.983575:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978177152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.983610:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978177152:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919469.983616:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919469.983627:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790919469.983634:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978177024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919469.983675:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978177024:12345-0@lo:400:kworker.0 Request processed in 41us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919469.983686:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1790919469.983716:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecda680 x1877914978177024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919469.983725:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978177024:0@lo:400:kworker.0 00010000:00080000:0.0:1790919469.983733:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9500 x1877914978177152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919469.983741:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978177152:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.983788:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790919469.983796:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978175744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.983825:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978175744:12345-0@lo:400:kworker.0 Request processed in 30us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.983831:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790919469.983841:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790919469.983846:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978176256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.983870:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978176256:12345-0@lo:400:kworker.0 Request processed in 23us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.983876:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790919469.983885:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790919469.983890:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978176768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.983924:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978176768:12345-0@lo:400:kworker.0 Request processed in 33us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.983930:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790919469.983941:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790919469.984013:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978176384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.984043:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978176384:12345-0@lo:400:kworker.0 Request processed in 96us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.984101:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790919469.984116:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790919469.984128:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978176896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.984157:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978176896:12345-0@lo:400:kworker.0 Request processed in 30us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.984163:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790919469.984202:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978175872:0@lo:400:kworker.0 00010000:00080000:2.0:1790919469.984212:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9c00 x1877914978176384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919469.984221:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978176384:0@lo:400:kworker.0 00010000:00080000:2.0:1790919469.984231:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecdbb80 x1877914978176896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919469.984239:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978176896:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.984248:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978175744:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.984257:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978176256:0@lo:400:kworker.0 00000100:00100000:2.0:1790919469.984265:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978176768:0@lo:400:kworker.0 00000100:00080000:2.0:1790919469.984289:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919469.984293:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919469.984295:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919469.984863:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978177408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919469.984899:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.984932:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919469.984938:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978177280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919469.985398:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919469.985430:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177408 00000100:00100000:2.0:1790919469.985443:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177408 00000100:00100000:2.0:1790919469.985473:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177280 00000100:00100000:2.0:1790919469.985476:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177280 00000100:00100000:2.0:1790919469.985488:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790919469.985496:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978177408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919469.985523:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919469.985561:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978177408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.985569:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790919469.985582:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790919469.985588:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978177280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919469.985597:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919469.985618:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978177280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919469.985624:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1790919469.985656:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a03100 x1877914978177280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919469.985672:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978177280:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790919469.985681:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a02680 x1877914978177408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919469.985692:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978177408:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790919470.493900:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919471.516477:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919472.541445:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919473.054975:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978177664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919473.055073:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919473.055147:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919473.055155:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978177536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919473.055189:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177664 00000100:00100000:0.0:1790919473.055193:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919473.055199:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177664 00000100:00100000:2.0:1790919473.055248:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177536 00000100:00100000:2.0:1790919473.055251:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177536 00000100:00100000:2.0:1790919473.055268:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919473.055289:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978177664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919473.055326:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919473.055384:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978177664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919473.055390:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919473.055405:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919473.055412:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978177536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919473.055430:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919473.055457:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978177536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919473.055463:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790919473.055565:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978177536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919473.055579:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978177664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919473.098588:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919473.098631:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919473.098666:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919473.098704:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919473.098728:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183680 00000100:00100000:1.0:1790919473.098736:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919473.098740:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183680 00000100:00100000:1.0:1790919473.098761:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919473.098806:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1790919473.098817:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919473.098828:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919473.098856:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183040 00000100:00100000:1.0:1790919473.098861:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183040 00000100:00100000:1.0:1790919473.098908:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:0.0:1790919473.098909:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919473.098920:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958183040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919473.098921:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1790919473.098947:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183808 00000100:00100000:0.0:1790919473.098951:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183808 00000100:00100000:1.0:1790919473.098956:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958183040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919473.098964:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:0.0:1790919473.098981:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1790919473.098990:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919473.098998:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183168 00000100:00100000:1.0:1790919473.099004:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183168 00000100:00100000:1.0:1790919473.099034:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183424 00000100:00100000:0.0:1790919473.099034:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919473.099039:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183424 00000100:00100000:0.0:1790919473.099045:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790919473.099084:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183296 00000100:00100000:1.0:1790919473.099088:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183296 00000100:00080000:0.0:1790919473.099099:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919473.099106:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919473.099108:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183552 00000100:00080000:0.0:1790919473.099110:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919473.099113:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183552 00000100:00080000:0.0:1790919473.099114:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919473.099144:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:1.0:1790919473.099152:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958183168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919473.099200:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958183168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 47us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919473.099207:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:1.0:1790919473.099221:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1790919473.099227:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919473.099257:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919473.099264:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00080000:0.0:1790919473.099273:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919473.099279:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:1.0:1790919473.099295:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958183296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919473.099306:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:0.0:1790919473.099316:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919473.099334:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958183296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919473.099342:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1790919473.099352:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958183552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919473.099364:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:3.0:1790919473.564345:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978177792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919473.564411:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919473.564495:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177792 00000100:00100000:3.0:1790919473.564502:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177792 00000100:00100000:3.0:1790919473.564554:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919473.564562:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978177792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919473.564596:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919473.564632:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978177792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919473.564639:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1790919473.564678:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32300 x1877914978177792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919473.564694:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978177792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919473.564708:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919473.564714:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978177920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919473.564748:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919473.564776:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978177920 00000100:00100000:3.0:1790919473.564780:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978177920 00000100:00100000:3.0:1790919473.564801:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790919473.564807:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978177920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919473.564817:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919473.564849:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978177920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919473.564872:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1790919473.565451:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919473.565462:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1790919473.565525:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bbfd5c00 x1877914978177920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919473.565544:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978177920:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790919474.588303:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919475.106625:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978178048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919475.106694:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.106741:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978178560:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.106766:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.106789:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978179072:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.106813:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.106835:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978179584:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.106855:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.106891:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1790919475.106897:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978178176:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.108030:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.108079:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978178688:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.108108:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.108133:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978179200:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.108157:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.108172:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978179712:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.108190:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.108215:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978178304:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.108237:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.108252:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978178816:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108356:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978178432:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108384:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919475.108403:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978178944:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108422:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919475.108510:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978179456:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108531:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919475.108563:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179072 00000100:00100000:0.0:1790919475.108578:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179072 00000100:00100000:0.0:1790919475.108620:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179584 00000100:00100000:0.0:1790919475.108623:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179584 00000100:00100000:0.0:1790919475.108635:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179200 00000100:00100000:0.0:1790919475.108638:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179200 00000100:00100000:0.0:1790919475.108649:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179712 00000100:00100000:0.0:1790919475.108651:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179712 00000100:00100000:0.0:1790919475.108665:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790919475.108673:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108726:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978179072:12345-0@lo:400:kworker.0 Request processed in 54us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.108733:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790919475.108749:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919475.108755:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978179584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108782:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978179584:12345-0@lo:400:kworker.0 Request processed in 28us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.108788:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919475.108798:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790919475.108804:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978179200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108830:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978179200:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.108835:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790919475.108845:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919475.108851:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.108887:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978179712:12345-0@lo:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.108892:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919475.109492:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.109548:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978179328:0@lo:400:kworker.0 00000100:00100000:2.0:1790919475.109574:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919475.109623:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178176 00000100:00100000:0.0:1790919475.109629:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178176 00000100:00100000:0.0:1790919475.109659:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1790919475.109666:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.109700:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978178176:12345-0@lo:400:kworker.0 Request processed in 35us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.109706:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1790919475.109739:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178560 00000100:00100000:0.0:1790919475.109743:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178560 00000100:00100000:0.0:1790919475.109765:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178432 00000100:00100000:0.0:1790919475.109767:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178432 00000100:00100000:0.0:1790919475.109779:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790919475.109784:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978178560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.109818:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978178560:12345-0@lo:400:kworker.0 Request processed in 34us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.109824:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790919475.109835:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790919475.109841:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978178432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.109880:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978178432:12345-0@lo:400:kworker.0 Request processed in 30us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919475.109886:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790919475.112610:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978179840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919475.112666:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919475.112716:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178048 00000100:00100000:2.0:1790919475.112723:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178048 00000100:00100000:2.0:1790919475.112763:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179840 00000100:00100000:2.0:1790919475.112766:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179840 00000100:00100000:2.0:1790919475.112781:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790919475.112789:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978178048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919475.112822:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919475.112860:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978178048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (6166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919475.112867:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790919475.112895:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919475.112900:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978179840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919475.113044:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919475.113112:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978179840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 211us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919475.113120:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790919475.113200:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178688 00000100:00100000:3.0:1790919475.113205:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178688 00000100:00100000:3.0:1790919475.113228:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178304 00000100:00100000:3.0:1790919475.113230:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178304 00000100:00100000:3.0:1790919475.113240:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178944 00000100:00100000:3.0:1790919475.113242:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178944 00000100:00100000:3.0:1790919475.113254:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179456 00000100:00100000:3.0:1790919475.113257:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179456 00000100:00100000:3.0:1790919475.113276:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978178816 00000100:00100000:3.0:1790919475.113280:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978178816 00000100:00100000:3.0:1790919475.113291:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179328 00000100:00100000:3.0:1790919475.113293:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179328 00000100:00100000:3.0:1790919475.113304:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790919475.113310:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919475.113346:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978178688:12345-0@lo:400:kworker.0 Request processed in 36us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919475.113352:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790919475.113362:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790919475.113367:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978178304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919475.113390:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978178304:12345-0@lo:400:kworker.0 Request processed in 22us (5152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919475.113395:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790919475.113405:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790919475.113417:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978178944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919475.113455:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978178944:12345-0@lo:400:kworker.0 Request processed in 39us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919475.113461:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790919475.113471:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790919475.113476:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978179456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919475.113500:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978179456:12345-0@lo:400:kworker.0 Request processed in 24us (4969us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919475.113505:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790919475.113514:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790919475.113520:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978178816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919475.113542:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978178816:12345-0@lo:400:kworker.0 Request processed in 23us (4113us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919475.113547:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790919475.113555:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790919475.113560:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978179328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919475.113581:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978179328:12345-0@lo:400:kworker.0 Request processed in 21us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919475.113587:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1790919475.113861:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919475.113866:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919475.113876:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919475.113879:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919475.113908:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978178176:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.113933:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978178688:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.113959:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9180 x1877914978179200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.113969:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978179200:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.113981:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d84a80 x1877914978179712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.113990:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978179712:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.113999:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9c00 x1877914978178048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.114013:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978178048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919475.114023:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978178560:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.114035:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd8a80 x1877914978179072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.114043:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978179072:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.114085:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d85c00 x1877914978179584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.114093:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978179584:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.114151:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978178432:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.114161:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9880 x1877914978178944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.114169:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978178944:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.114178:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d86a00 x1877914978179456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.114192:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978179456:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.117127:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978178304:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.117145:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978178816:0@lo:400:kworker.0 00000100:00100000:0.0:1790919475.117156:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978179328:0@lo:400:kworker.0 00010000:00080000:0.0:1790919475.117171:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c32680 x1877914978179840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919475.117190:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978179840:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790919475.612909:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919476.637295:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919477.664636:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919478.172512:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978179968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919478.172578:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919478.172647:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978179968 00000100:00100000:0.0:1790919478.172654:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978179968 00000100:00100000:0.0:1790919478.172699:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790919478.172708:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978179968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919478.172749:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919478.172794:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978179968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919478.172801:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790919478.172842:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978179968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919478.174006:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978180096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919478.175505:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919478.175693:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180096 00000100:00100000:2.0:1790919478.175703:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180096 00000100:00100000:2.0:1790919478.175749:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919478.175758:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978180096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919478.175799:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919478.175871:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978180096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919478.175878:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919478.175930:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978180096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919478.223891:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919478.223936:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919478.223966:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919478.224000:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919478.224021:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919478.224041:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919478.224136:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958183936 00000100:00100000:1.0:1790919478.224146:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958183936 00000100:00100000:1.0:1790919478.224206:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 304 00000100:00100000:1.0:1790919478.224216:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958183936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919478.224283:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958183936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919478.224290:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 304 00000100:00100000:3.0:1790919478.224570:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184192 00000100:00100000:3.0:1790919478.224576:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184192 00000100:00100000:3.0:1790919478.224619:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184448 00000100:00100000:3.0:1790919478.224622:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184448 00000100:00100000:3.0:1790919478.224642:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184064 00000100:00100000:3.0:1790919478.224645:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184064 00000100:00100000:3.0:1790919478.224659:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1790919478.224673:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958184192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919478.224712:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958184192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919478.224719:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1790919478.224734:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:3.0:1790919478.224741:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919478.224765:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919478.224770:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:3.0:1790919478.224782:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:3.0:1790919478.224788:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958184064:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919478.224812:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958184064:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919478.224818:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00080000:1.0:1790919478.225189:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919478.225202:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919478.226719:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919478.226746:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184320 00000100:00100000:0.0:1790919478.226753:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184320 00000100:00100000:0.0:1790919478.226798:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:0.0:1790919478.226806:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919478.226875:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919478.226882:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:0.0:1790919478.226906:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184704 00000100:00100000:0.0:1790919478.226909:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184704 00000100:00100000:0.0:1790919478.226932:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184576 00000100:00100000:0.0:1790919478.226935:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184576 00000100:00100000:0.0:1790919478.226955:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790919478.226961:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184704:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919478.226986:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184704:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919478.226992:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790919478.227002:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1790919478.227007:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184576:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919478.227025:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958184576:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919478.227037:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00080000:0.0:1790919478.227925:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919478.227931:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919478.227933:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790919478.685772:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919478.685854:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919478.685873:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978180224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919478.685941:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919478.686001:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180224 00000100:00100000:3.0:1790919478.686010:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180224 00000100:00100000:3.0:1790919478.686074:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790919478.686083:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978180224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919478.686117:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919478.686160:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978180224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919478.686180:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1790919478.686237:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bbfd5c00 x1877914978180224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919478.686255:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978180224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790919478.687794:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919478.688535:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978180352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919478.688597:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919478.689195:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180352 00000100:00100000:2.0:1790919478.689214:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180352 00000100:00100000:2.0:1790919478.689274:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790919478.689283:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978180352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790919478.689305:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919478.689355:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978180352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919478.689362:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1790919478.689473:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790919478.689503:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d87480 x1877914978180352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919478.689520:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978180352:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790919479.718270:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919480.226938:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978180480:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227016:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227097:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978180992:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227127:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227147:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978181504:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227172:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227188:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978182016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227214:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227242:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790919480.227249:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978180864:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227277:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227296:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978181376:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227330:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227348:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978181888:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227369:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227401:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978180608:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227428:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227453:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978181120:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227477:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227500:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978181632:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227524:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227541:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978182144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919480.227567:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227599:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1790919480.227606:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978180736:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227635:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227652:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3be4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978181248:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227674:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227689:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978181760:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.227708:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227718:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978182272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919480.227751:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919480.227987:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180480 00000100:00100000:0.0:1790919480.227995:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180480 00000100:00100000:0.0:1790919480.228038:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790919480.228048:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978180480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228133:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978180480:12345-0@lo:400:kworker.0 Request processed in 85us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228141:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790919480.228174:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180992 00000100:00100000:0.0:1790919480.228177:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180992 00000100:00100000:0.0:1790919480.228194:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180608 00000100:00100000:0.0:1790919480.228196:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180608 00000100:00100000:0.0:1790919480.228209:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181120 00000100:00100000:0.0:1790919480.228211:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181120 00000100:00100000:0.0:1790919480.228230:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181632 00000100:00100000:0.0:1790919480.228233:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181632 00000100:00100000:0.0:1790919480.228244:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181248 00000100:00100000:0.0:1790919480.228246:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181248 00000100:00100000:0.0:1790919480.228257:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181760 00000100:00100000:0.0:1790919480.228259:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181760 00000100:00100000:0.0:1790919480.228272:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790919480.228278:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978180992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228309:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978180992:12345-0@lo:400:kworker.0 Request processed in 31us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228314:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790919480.228325:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790919480.228330:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978180608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228360:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978180608:12345-0@lo:400:kworker.0 Request processed in 30us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228366:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790919480.228377:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790919480.228383:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978181120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228422:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978181120:12345-0@lo:400:kworker.0 Request processed in 40us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228435:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790919480.228447:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790919480.228453:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978181632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228489:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978181632:12345-0@lo:400:kworker.0 Request processed in 37us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228494:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790919480.228506:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790919480.228512:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978181248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228540:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978181248:12345-0@lo:400:kworker.0 Request processed in 29us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228545:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790919480.228555:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790919480.228561:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978181760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228586:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978181760:12345-0@lo:400:kworker.0 Request processed in 25us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228591:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790919480.228608:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181504 00000100:00100000:0.0:1790919480.228611:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181504 00000100:00100000:0.0:1790919480.228628:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182016 00000100:00100000:0.0:1790919480.228631:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182016 00000100:00100000:0.0:1790919480.228643:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181376 00000100:00100000:0.0:1790919480.228646:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181376 00000100:00100000:0.0:1790919480.228657:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978181888 00000100:00100000:0.0:1790919480.228659:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978181888 00000100:00100000:0.0:1790919480.228671:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919480.228676:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978181504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228716:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978181504:12345-0@lo:400:kworker.0 Request processed in 40us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228723:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919480.228734:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790919480.228741:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.228770:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978182016:12345-0@lo:400:kworker.0 Request processed in 29us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228776:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790919480.228788:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790919480.228795:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978181376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919480.228807:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182144 00000100:00100000:2.0:1790919480.228813:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182144 00000100:00100000:0.0:1790919480.228826:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978181376:12345-0@lo:400:kworker.0 Request processed in 31us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228845:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919480.228854:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182272 00000100:00100000:2.0:1790919480.228859:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182272 00000100:00100000:0.0:1790919480.228863:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790919480.228873:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978181888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919480.228881:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790919480.228891:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978182144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919480.228906:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978181888:12345-0@lo:400:kworker.0 Request processed in 34us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.228912:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00002000:00000024:2.0:1790919480.228921:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919480.228939:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180864 00000100:00100000:0.0:1790919480.228943:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180864 00000100:00100000:0.0:1790919480.228971:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978180736 00000100:00100000:0.0:1790919480.228975:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978180736 00000100:00100000:2.0:1790919480.228976:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978182144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919480.228986:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919480.229006:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790919480.229014:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390351850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978180864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.229073:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390351850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978180864:12345-0@lo:400:kworker.0 Request processed in 60us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.229091:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790919480.229322:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790919480.229421:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790919480.229430:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978180736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.229465:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978180736:12345-0@lo:400:kworker.0 Request processed in 37us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919480.229471:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790919480.231443:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978182272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919480.231470:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919480.231540:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978182272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (3788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919480.234846:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978180864:0@lo:400:kworker.0 00010000:00080000:1.0:1790919480.234870:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5500 x1877914978181376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919480.234882:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978181376:0@lo:400:kworker.0 00010000:00080000:1.0:1790919480.234895:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bc380 x1877914978181888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919480.234904:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978181888:0@lo:400:kworker.0 00000100:00100000:1.0:1790919480.234914:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978180480:0@lo:400:kworker.0 00000100:00100000:1.0:1790919480.234926:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978180992:0@lo:400:kworker.0 00010000:00080000:1.0:1790919480.234952:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c7800 x1877914978181504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919480.234959:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978181504:0@lo:400:kworker.0 00010000:00080000:1.0:1790919480.234970:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bc000 x1877914978182016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919480.234978:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978182016:0@lo:400:kworker.0 00000100:00080000:0.0:1790919480.235266:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919480.235273:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919480.235276:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919480.235278:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919480.235304:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978180736:0@lo:400:kworker.0 00010000:00080000:0.0:1790919480.235318:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3be4c5180 x1877914978181248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919480.235328:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978181248:0@lo:400:kworker.0 00010000:00080000:0.0:1790919480.235339:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bd880 x1877914978181760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919480.235347:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978181760:0@lo:400:kworker.0 00010000:00080000:0.0:1790919480.235359:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f398da8e00 x1877914978182272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919480.235374:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978182272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919480.235387:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978180608:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.235398:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3be4c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978181120:0@lo:400:kworker.0 00000100:00100000:0.0:1790919480.235409:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978181632:0@lo:400:kworker.0 00010000:00080000:0.0:1790919480.235430:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bce00 x1877914978182144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919480.235453:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978182144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919480.237154:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1790919480.738982:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919481.756264:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919482.785423:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919483.292369:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919483.292393:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978182400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919483.292466:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919483.292536:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978182528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919483.292563:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919483.292644:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182400 00000100:00100000:1.0:1790919483.292652:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182400 00000100:00100000:0.0:1790919483.292705:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182528 00000100:00100000:0.0:1790919483.292709:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182528 00000100:00100000:0.0:1790919483.292739:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790919483.292747:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978182400:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919483.292778:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790919483.292785:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978182528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919483.292830:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919483.292878:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978182528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919483.292885:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790919483.292927:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978182528:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919483.297603:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919483.297710:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978182400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4960us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919483.297738:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790919483.297883:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978182400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919483.336450:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919483.336493:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919483.336530:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919483.336561:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919483.336654:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919483.336676:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919483.336697:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919483.336784:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185088 00000100:00100000:1.0:1790919483.336795:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185088 00000100:00100000:1.0:1790919483.336874:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185344 00000100:00100000:1.0:1790919483.336878:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185344 00000100:00100000:1.0:1790919483.336893:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184960 00000100:00100000:1.0:1790919483.336896:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184960 00000100:00100000:1.0:1790919483.336907:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185216 00000100:00100000:1.0:1790919483.336909:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185216 00000100:00100000:1.0:1790919483.336925:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:1.0:1790919483.336942:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958185088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919483.337017:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958185088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 84us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919483.337024:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:1.0:1790919483.337042:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:1.0:1790919483.337048:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958185344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919483.337103:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958185344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919483.337109:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:1.0:1790919483.337120:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1790919483.337126:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958184960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919483.337148:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958184960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919483.337153:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1790919483.337163:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:1.0:1790919483.337183:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958185216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919483.337209:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958185216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919483.337215:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00080000:3.0:1790919483.337483:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919483.337487:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919483.337888:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958184832 00000100:00100000:0.0:1790919483.337895:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958184832 00000100:00100000:0.0:1790919483.338028:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:0.0:1790919483.338039:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958184832:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919483.338115:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958184832:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919483.338122:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:0.0:1790919483.338160:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185472 00000100:00100000:0.0:1790919483.338164:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185472 00000100:00100000:0.0:1790919483.338192:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185600 00000100:00100000:0.0:1790919483.338195:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185600 00000100:00100000:0.0:1790919483.338226:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919483.338233:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2410:x1877914958185472:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1790919483.338252:0:8083:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913708 00000100:00080000:0.0:1790919483.338260:0:8083:0:(import.c:65:import_set_state_nolock()) ffff95f3a6baf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919483.338297:0:8083:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1790919483.338520:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1790919483.338532:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2410:x1877914958185600:12345-192.168.203.11@tcp:9:kworker.0 00000100:00100000:0.0:1790919483.338549:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+2:2410:x1877914958185472:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 315us (1870us total) trans 0 rc 0/0 00000020:00000080:2.0:1790919483.338550:0:8084:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591370f 00000100:00080000:2.0:1790919483.338559:0:8084:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b5000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790919483.338560:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000001:00000004:2.0:1790919483.338590:0:8084:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1790919483.338757:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919483.338762:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790919483.338777:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919483.338782:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+2:2410:x1877914958185600:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 253us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919483.338791:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00010000:00010000:1.0:1790919483.339015:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919483.804778:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1790919483.809525:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919483.809722:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978182656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919483.809794:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919483.811905:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182656 00000100:00100000:3.0:1790919483.811918:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182656 00000100:00100000:3.0:1790919483.811993:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790919483.812005:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978182656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919483.812046:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919483.812155:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978182656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919483.812179:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1790919483.812205:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919483.812486:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d87800 x1877914978182656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919483.812506:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978182656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919483.813048:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919483.813079:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978182784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919483.813136:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919483.813220:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182784 00000100:00100000:2.0:1790919483.813227:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182784 00000100:00100000:2.0:1790919483.813285:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790919483.813294:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978182784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919483.813310:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919483.813349:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978182784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919483.813355:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1790919483.813396:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c33480 x1877914978182784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919483.813411:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978182784:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790919483.813533:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1790919484.221883:0:12582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790919484.828835:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919485.341041:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919485.341090:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978182912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919485.341182:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.341729:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978183040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.341784:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.341831:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978183552:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.341861:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.341893:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978184064:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.341925:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.341952:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790919485.341958:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978183424:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.341990:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342009:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978183936:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.342035:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342382:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978184448:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.342417:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342455:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978183168:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.342484:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342520:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978183680:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.342549:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342581:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978184192:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.342611:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342644:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790919485.342651:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978183296:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.342686:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342709:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978183808:0@lo:400:kworker.0 00000100:00100000:3.0:1790919485.342724:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919485.342736:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919485.342740:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978184576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919485.342759:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978184320:0@lo:400:kworker.0 00000100:00100000:3.0:1790919485.342789:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342804:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919485.342840:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183040 00000100:00100000:3.0:1790919485.342850:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978182912 00000100:00100000:2.0:1790919485.342850:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183040 00000100:00100000:3.0:1790919485.342856:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978182912 00000100:00100000:3.0:1790919485.342909:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184576 00000100:00100000:3.0:1790919485.342913:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184576 00000100:00100000:2.0:1790919485.342918:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790919485.342935:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978183040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919485.342936:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919485.342950:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978182912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919485.342990:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919485.343005:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978183040:12345-0@lo:400:kworker.0 Request processed in 76us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343014:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1790919485.343037:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978182912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919485.343044:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919485.343080:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183552 00000100:00100000:2.0:1790919485.343085:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183552 00000100:00100000:3.0:1790919485.343090:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790919485.343100:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978184576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919485.343112:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919485.343114:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183168 00000100:00100000:2.0:1790919485.343119:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183168 00000100:00100000:2.0:1790919485.343136:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183680 00000100:00100000:2.0:1790919485.343139:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183680 00000100:00100000:3.0:1790919485.343149:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978184576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919485.343158:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790919485.343158:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184192 00000100:00100000:2.0:1790919485.343163:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184192 00000100:00100000:2.0:1790919485.343185:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183808 00000100:00100000:2.0:1790919485.343188:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183808 00000100:00100000:2.0:1790919485.343203:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184320 00000100:00100000:2.0:1790919485.343205:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184320 00000100:00100000:3.0:1790919485.343211:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978183040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343223:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790919485.343234:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978183552:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790919485.343248:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac0380 x1877914978182912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919485.343270:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978182912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919485.343279:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978183552:12345-0@lo:400:kworker.0 Request processed in 45us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343296:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790919485.343304:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978183552:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343314:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790919485.343322:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978183168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790919485.343333:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919485.343339:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919485.343343:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919485.343364:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978183168:12345-0@lo:400:kworker.0 Request processed in 43us (880us total) trans 0 rc 0/0 00010000:00080000:3.0:1790919485.343373:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bbfd4380 x1877914978184576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919485.343373:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790919485.343392:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790919485.343393:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978184576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919485.343404:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978183680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343435:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978183680:12345-0@lo:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343440:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790919485.343452:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790919485.343457:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978184192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343482:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978184192:12345-0@lo:400:kworker.0 Request processed in 25us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343488:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790919485.343500:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790919485.343505:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978183808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343536:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978183808:12345-0@lo:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343541:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790919485.343555:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790919485.343561:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978184320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343585:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978184320:12345-0@lo:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343596:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790919485.343615:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184064 00000100:00100000:2.0:1790919485.343619:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184064 00000100:00100000:2.0:1790919485.343656:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183936 00000100:00100000:2.0:1790919485.343659:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183936 00000100:00100000:2.0:1790919485.343670:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184448 00000100:00100000:2.0:1790919485.343672:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184448 00000100:00100000:2.0:1790919485.343681:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919485.343685:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978184064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343718:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978184064:12345-0@lo:400:kworker.0 Request processed in 32us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343723:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919485.343734:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790919485.343739:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978183936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343762:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978183936:12345-0@lo:400:kworker.0 Request processed in 23us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343767:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790919485.343775:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790919485.343780:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978184448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343814:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978184448:12345-0@lo:400:kworker.0 Request processed in 33us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343821:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790919485.343840:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183424 00000100:00100000:2.0:1790919485.343844:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183424 00000100:00100000:2.0:1790919485.343868:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978183296 00000100:00100000:2.0:1790919485.343871:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978183296 00000100:00100000:2.0:1790919485.343885:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790919485.343902:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978183424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.343942:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978183424:12345-0@lo:400:kworker.0 Request processed in 43us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.343949:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790919485.343963:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790919485.343969:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978183296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.344002:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978183296:12345-0@lo:400:kworker.0 Request processed in 32us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919485.344009:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790919485.344105:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978183296:0@lo:400:kworker.0 00010000:00080000:2.0:1790919485.344118:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d86300 x1877914978183808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919485.344128:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978183808:0@lo:400:kworker.0 00010000:00080000:2.0:1790919485.344141:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54a300 x1877914978184320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919485.344150:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978184320:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.344165:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978183168:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.344176:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978183680:0@lo:400:kworker.0 00000100:00100000:2.0:1790919485.344189:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978184192:0@lo:400:kworker.0 00000100:00080000:3.0:1790919485.344768:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919485.344881:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978183424:0@lo:400:kworker.0 00010000:00080000:3.0:1790919485.344897:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d86a00 x1877914978183936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919485.344908:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978183936:0@lo:400:kworker.0 00010000:00080000:3.0:1790919485.344919:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54aa00 x1877914978184448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919485.344927:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978184448:0@lo:400:kworker.0 00010000:00080000:3.0:1790919485.344939:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d85c00 x1877914978184064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919485.344948:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978184064:0@lo:400:kworker.0 00010000:00010000:1.0:1790919485.853272:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919486.837913:0:12729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2bc24870 20000000:00000080:2.0:1790919486.837929:0:12729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f283b15c00 uarg=0000000000000000 20000000:01000000:2.0:1790919486.837965:0:12729:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919486.837971:0:12729:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919486.837981:0:12729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790919486.839234:0:12730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790919486.839393:0:12729:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790919486.853332:0:12729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790919486.853473:0:12729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853494:0:12729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853502:0:12729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136ad expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853509:0:12729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136bb expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853515:0:12729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136c9 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853521:0:12729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159136d7 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853527:0:12729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853535:0:12729:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853589:0:12729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853606:0:12729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 12 pid: 6438 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.853622:0:12729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978184704:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919486.853735:0:12729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159136d7 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853745:0:12729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159136d7 expref: 23 pid: 6439 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.853754:0:12729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978184832:0@lo:104: 00000100:00100000:0.0:1790919486.853810:0:12729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919486.853935:0:12729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159136c9 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.853944:0:12729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159136c9 expref: 23 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.853954:0:12729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978184960:0@lo:104: 00000100:00100000:0.0:1790919486.856172:0:12729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919486.858305:0:12729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159136bb expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.858324:0:12729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159136bb expref: 23 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.858359:0:12729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978185088:0@lo:104: 00000100:00100000:0.0:1790919486.858398:0:12729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919486.859319:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184832 00000100:00100000:3.0:1790919486.859337:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184832 00000100:00100000:3.0:1790919486.859375:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978184960 00000100:00100000:3.0:1790919486.859378:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978184960 00010000:00010000:0.0:1790919486.859454:0:12729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159136ad expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.859466:0:12729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159136ad expref: 23 pid: 6438 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.859476:0:12729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978185216:0@lo:104: 00000100:00100000:0.0:1790919486.859507:0:12729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919486.859529:0:12729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.859537:0:12729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.859548:0:12729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978185344:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919486.859619:0:12729:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919486.859643:0:12729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978184704:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919486.860107:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185088 00000100:00100000:3.0:1790919486.860112:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185088 00000100:00100000:3.0:1790919486.860128:0:6428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185216 00000100:00100000:3.0:1790919486.860130:0:6428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185216 00000100:00100000:3.0:1790919486.860142:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919486.860150:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:12729:x1877914978184832:12345-0@lo:104: 00010000:00010000:3.0:1790919486.860163:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860233:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919486.860240:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:12729:x1877914978184832:12345-0@lo:104: Request processed in 91us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.860247:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919486.860264:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919486.860271:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:12729:x1877914978184960:12345-0@lo:104: 00010000:00010000:3.0:1790919486.860278:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860311:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919486.860316:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:12729:x1877914978184960:12345-0@lo:104: Request processed in 46us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.860322:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919486.860336:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919486.860342:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:12729:x1877914978185088:12345-0@lo:104: 00010000:00010000:3.0:1790919486.860350:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.860370:0:12729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978184832:0@lo:104: 00000100:00100000:0.0:1790919486.860384:0:12729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978184960:0@lo:104: 00010000:00010000:3.0:1790919486.860415:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790919486.860416:0:12729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978185088:0@lo:104: 00000100:00100000:3.0:1790919486.860424:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:12729:x1877914978185088:12345-0@lo:104: Request processed in 81us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.860430:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919486.860443:0:6428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790919486.860448:0:6428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:12729:x1877914978185216:12345-0@lo:104: 00010000:00010000:3.0:1790919486.860456:0:6428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860491:0:6428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790919486.860497:0:6428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:12729:x1877914978185216:12345-0@lo:104: Request processed in 49us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.860503:0:6428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1790919486.860519:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790919486.860525:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860533:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6486000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919486.860538:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.860540:0:12729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978185216:0@lo:104: 00010000:00010000:3.0:1790919486.860553:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919486.860561:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919486.860567:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919486.860608:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860614:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919486.860634:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860640:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad159136d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136de expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860652:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790919486.860655:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860660:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919486.860664:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860671:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919486.860677:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919486.860681:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919486.860694:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860699:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919486.860706:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860721:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad159136c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136d0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860730:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919486.860733:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860738:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015a00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919486.860741:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860747:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919486.860753:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919486.860758:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919486.860770:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860775:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919486.860799:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860806:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015a00/0x951c50ad159136bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136c2 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860815:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919486.860823:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860829:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919486.860832:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860838:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919486.860844:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919486.860853:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919486.860865:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860871:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919486.860876:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860882:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad159136ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159136b4 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.860894:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919486.860896:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919486.860898:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919486.860904:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919486.860909:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919486.860925:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978185472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919486.860957:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919486.860996:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919486.861003:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978185600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919486.861025:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919486.861077:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978185728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919486.861095:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185472 00000100:00100000:3.0:1790919486.861101:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919486.861101:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185472 00000100:00100000:3.0:1790919486.861121:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1790919486.861128:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136d7 expref: 24 pid: 6439 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919486.861129:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978185856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919486.861150:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919486.861163:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185600 00000100:00100000:0.0:1790919486.861169:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185600 00000100:00100000:3.0:1790919486.861178:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185728 00000100:00100000:3.0:1790919486.861183:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185728 00010000:00010000:0.0:1790919486.861186:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136c9 expref: 25 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.861201:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136bb expref: 26 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.861202:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185856 00000100:00100000:0.0:1790919486.861207:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185856 00000100:00100000:3.0:1790919486.861225:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1790919486.861225:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136ad expref: 27 pid: 6438 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919486.861235:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+27:3460:x1877914978185472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919486.861246:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790919486.861247:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1790919486.861254:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136d7 expref: 27 pid: 6439 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.861260:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+27:3460:x1877914978185600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919486.861270:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159136d7 expref: 27 pid: 6439 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.861273:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919486.861281:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136c9 expref: 27 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.861287:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6487c00/0x951c50ad159136de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159136d7 expref: 27 pid: 6439 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.861296:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159136c9 expref: 27 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919486.861393:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919486.861401:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2cc00/0x951c50ad159136d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159136c9 expref: 26 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919486.861407:0:6431:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:0.0:1790919486.861413:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919486.861418:0:6431:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1790919486.861429:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+25:3460:x1877914978185472:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.861437:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790919486.861454:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978185600:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.861462:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919486.861469:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790919486.861472:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978185728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919486.861482:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919486.861488:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136bb expref: 23 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.861493:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1790919486.861504:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159136bb expref: 23 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.861507:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3458:x1877914978185856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919486.861522:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015800/0x951c50ad159136c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159136bb expref: 23 pid: 6440 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.861532:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919486.861533:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919486.861552:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159136ad expref: 22 pid: 6438 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.861563:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159136ad expref: 22 pid: 6438 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919486.861568:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3458:x1877914978185728:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919486.861580:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1790919486.861583:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015600/0x951c50ad159136b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159136ad expref: 22 pid: 6438 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.861597:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919486.861614:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978185728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919486.861638:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978185600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919486.861650:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978185472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919486.861945:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3458:x1877914978185856:12345-0@lo:103:ldlm_bl.0 Request processed in 442us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919486.861953:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919486.862009:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919486.862096:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978185856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919486.862139:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185728 00000100:00100000:0.0:1790919486.862145:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185728 00010000:00010000:0.0:1790919486.862165:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 13 pid: 6438 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.862198:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:0.0:1790919486.862206:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958185728:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919486.862215:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919486.862219:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 13 pid: 6438 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.862229:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 13 pid: 6438 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.862240:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6487e00/0x951c50ad159136f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b60 expref: 13 pid: 6438 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.862257:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919486.862285:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8157f22-2e62-481b-a08b-6545627fb184+12:2413:x1877914958185728:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919486.862292:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790919486.864005:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919486.864248:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185856 00000100:00100000:2.0:1790919486.864256:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185856 00010000:00010000:2.0:1790919486.864288:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919486.864324:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790919486.864332:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8157f22-2e62-481b-a08b-6545627fb184+12:2413:x1877914958185856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919486.864344:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919486.864349:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864361:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864377:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864385:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864400:0:12731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864407:0:12731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864415:0:12731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.864434:0:12729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c200/0x951c50ad159136a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b21 expref: 12 pid: 6440 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919486.864448:0:12729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12729:1877914978185344:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919486.864521:0:12731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864679:0:12731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919486.864681:0:12729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864684:0:12731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.864701:0:12729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864702:0:12731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919486.864713:0:12729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864979:0:12731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.864988:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015c00/0x951c50ad15913716 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919486.865004:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919486.865367:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8157f22-2e62-481b-a08b-6545627fb184+11:2413:x1877914958185856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1033us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919486.865376:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00010000:00010000:2.0:1790919486.877311:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790919487.432113:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00000020:00000080:3.0:1790919487.432122:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f3a6bae000/a0eadf68-44c6-442a-b15d-9a125194f9a5 00000020:00000080:0.0:1790919487.432246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a6bae000/a0eadf68-44c6-442a-b15d-9a125194f9a5 for lustre-OST0000 00000020:00000080:0.0:1790919487.432671:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3a6baf800 for lustre-OST0000 00010000:00010000:3.0:1790919487.902078:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919488.074666:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919488.074810:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958185984 00000100:00100000:1.0:1790919488.074821:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958185984 00000100:00100000:1.0:1790919488.074921:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:1.0:1790919488.074930:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+11:6386:x1877914958185984:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919488.074945:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919488.074962:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b91 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.074988:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.075105:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.075125:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486400, rc 0) 00000100:00100000:1.0:1790919488.075174:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958185984:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 245us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919488.075181:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:1.0:1790919488.082400:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919488.083525:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186112 00000100:00100000:2.0:1790919488.083537:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186112 00000100:00100000:2.0:1790919488.083599:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 309 00000100:00100000:2.0:1790919488.083609:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958186112:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.083908:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958186112:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 299us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.083928:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 309 00000100:00100000:1.0:1790919488.089773:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919488.089933:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186240 00000100:00100000:3.0:1790919488.089943:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186240 00000100:00100000:3.0:1790919488.089997:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 310 00000100:00100000:3.0:1790919488.090007:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958186240:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.090247:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958186240:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 241us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.090255:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 310 00000100:00100000:3.0:1790919488.101081:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919488.101366:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186368 00000100:00100000:1.0:1790919488.101377:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186368 00000100:00100000:1.0:1790919488.101430:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 311 00000100:00100000:1.0:1790919488.101441:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958186368:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919488.101457:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919488.101474:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b98 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.101500:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 13 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.101512:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 13 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.101521:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487e00, rc 0) 00000100:00100000:1.0:1790919488.101593:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958186368:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 154us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919488.101601:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 311 00000100:00100000:1.0:1790919488.103585:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919488.103684:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186496 00000100:00100000:2.0:1790919488.103693:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186496 00000100:00100000:2.0:1790919488.103771:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 312 00000100:00100000:2.0:1790919488.103790:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958186496:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.104065:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958186496:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 260us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.104075:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 312 00000100:00100000:3.0:1790919488.105546:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919488.106816:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186624 00000100:00100000:1.0:1790919488.106841:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186624 00000100:00100000:1.0:1790919488.106886:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 313 00000100:00100000:1.0:1790919488.106895:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958186624:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.107135:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958186624:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 239us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919488.107144:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 313 10000000:01000000:3.0:1790919488.285284:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919488.285293:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3a6ada000 from 7 10000000:01000000:3.0:1790919488.285306:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919488.285354:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919488.285367:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919488.285378:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919488.285402:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978185984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.285471:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.285517:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919488.285569:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978185984 00000100:00100000:0.0:1790919488.285577:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978185984 00000100:00100000:0.0:1790919488.285627:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1790919488.285636:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978185984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919488.285657:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919488.285671:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591372b expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919488.285708:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591372b expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919488.285718:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591372b expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919488.285728:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014c00, rc 0) 00000100:00100000:0.0:1790919488.285785:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978185984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919488.285794:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1790919488.287361:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978185984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919488.287384:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919488.287395:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919488.287460:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.287513:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.287553:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919488.289928:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186112 00000100:00100000:0.0:1790919488.289940:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186112 00000100:00100000:0.0:1790919488.289985:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1790919488.289996:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978186112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919488.290565:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978186112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 571us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919488.290574:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1790919488.290725:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.290771:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.290826:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.290863:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919488.291341:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186240 00000100:00100000:0.0:1790919488.291347:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186240 00000100:00100000:0.0:1790919488.291376:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1790919488.291384:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978186240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919488.291539:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978186240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919488.291546:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1790919488.291588:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790919488.294921:0:12817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790919488.295960:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790919488.295986:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919488.295997:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.296009:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919488.296019:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919488.296022:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3be491000 from 7 10000000:01000000:1.0:1790919488.296025:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919488.296182:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.296250:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.296263:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919488.296287:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.296351:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919488.296387:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919488.298012:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186368 00000100:00100000:0.0:1790919488.298024:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186368 00000100:00100000:0.0:1790919488.298100:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790919488.298112:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978186368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919488.298128:0:6438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919488.298144:0:6438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913739 expref: -99 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919488.298172:0:6438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913739 expref: 22 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919488.298183:0:6438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913739 expref: 22 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919488.298193:0:6438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015000, rc 0) 00000100:00100000:0.0:1790919488.298406:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978186368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919488.298414:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1790919488.298950:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919488.298970:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.298980:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919488.299080:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.299125:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919488.299278:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919488.299320:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186496 00000100:00100000:1.0:1790919488.299326:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186496 00000100:00100000:1.0:1790919488.299355:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1790919488.299362:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978186496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.299605:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978186496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919488.299613:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1790919488.300139:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.300831:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.300890:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919488.300930:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919488.301172:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186624 00000100:00100000:3.0:1790919488.301178:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186624 00000100:00100000:3.0:1790919488.301216:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1790919488.301225:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978186624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.301410:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978186624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.301417:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1790919488.301862:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790919488.303229:0:12821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790919488.304843:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790919488.304878:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919488.304890:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.304911:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919488.304922:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919488.304925:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4712800 from 7 10000000:01000000:1.0:1790919488.304927:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919488.304960:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.304968:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.304981:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919488.305004:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.306116:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919488.306157:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919488.306274:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186752 00000100:00100000:2.0:1790919488.306282:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186752 00000100:00100000:2.0:1790919488.306334:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1790919488.306344:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978186752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919488.306359:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919488.306372:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913747 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.306397:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913747 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.306407:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913747 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.306415:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204ae00, rc 0) 00000100:00100000:2.0:1790919488.306555:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978186752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.306562:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1790919488.307578:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919488.307599:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919488.307608:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919488.307672:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.307714:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.307751:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a840 going to sleep for 11 seconds 00000100:00100000:2.0:1790919488.307815:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978186880 00000100:00100000:2.0:1790919488.307822:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978186880 00000100:00100000:2.0:1790919488.307859:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1790919488.307867:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978186880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.308122:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978186880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.308130:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1790919488.308245:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978186880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.308286:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.308333:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.308357:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a840 going to sleep for 11 seconds 00000100:00100000:2.0:1790919488.308439:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187008 00000100:00100000:2.0:1790919488.308444:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187008 00000100:00100000:2.0:1790919488.308475:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1790919488.308483:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978187008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.308680:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978187008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.308687:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1790919488.308912:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790919488.309962:0:12822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790919488.310166:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790919488.310183:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919488.310193:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.310203:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919488.310213:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919488.310222:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385571800 from 7 10000000:01000000:1.0:1790919488.310224:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919488.310254:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.310262:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919488.310270:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919488.310287:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919488.310487:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919488.310522:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919488.310583:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187136 00000100:00100000:2.0:1790919488.310590:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187136 00000100:00100000:2.0:1790919488.310620:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1790919488.310627:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978187136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919488.310639:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919488.310652:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15913755 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.310674:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15913755 expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.310685:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913755 expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.310705:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204b200, rc 0) 00000100:00100000:2.0:1790919488.310755:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978187136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.310763:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790919488.310858:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919488.310871:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919488.310881:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919488.310931:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919488.310958:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.310981:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f287335180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919488.311026:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187264 00000100:00100000:2.0:1790919488.311032:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187264 00000100:00100000:2.0:1790919488.311087:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1790919488.311094:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978187264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.311339:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978187264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.311346:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1790919488.311376:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.311402:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.311435:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919488.311457:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f86900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919488.311467:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187392 00000100:00100000:2.0:1790919488.311470:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187392 00000100:00100000:2.0:1790919488.311485:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1790919488.311490:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978187392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919488.311641:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978187392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.311648:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1790919488.311685:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978187392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790919488.312859:0:12823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790919488.313014:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790919488.313044:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919488.313252:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919488.313264:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919488.413247:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978187520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919488.413321:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919488.413396:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187520 00000100:00100000:2.0:1790919488.413404:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187520 00000100:00100000:2.0:1790919488.413455:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790919488.413465:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978187520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919488.413502:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919488.413558:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978187520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.413565:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790919488.413607:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978187520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919488.415392:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978187648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919488.415445:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919488.415490:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187648 00000100:00100000:2.0:1790919488.415497:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187648 00000100:00100000:2.0:1790919488.415542:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919488.415551:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978187648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919488.415584:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919488.415627:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978187648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919488.415645:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919488.415686:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978187648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919488.459644:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919488.459676:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919488.459698:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919488.459720:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919488.459754:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186752 00000100:00100000:3.0:1790919488.459764:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186752 00000100:00100000:3.0:1790919488.459843:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958187008 00000100:00100000:3.0:1790919488.459846:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958187008 00000100:00100000:3.0:1790919488.459860:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958186880 00000100:00100000:3.0:1790919488.459863:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958186880 00000100:00100000:3.0:1790919488.459874:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958187136 00000100:00100000:3.0:1790919488.459876:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958187136 00000100:00100000:3.0:1790919488.459890:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1790919488.459899:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958186752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919488.459978:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958186752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 79us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.459986:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1790919488.460003:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:3.0:1790919488.460009:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958187008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919488.460034:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958187008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.460040:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:3.0:1790919488.460082:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1790919488.460090:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958186880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919488.460116:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958186880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.460122:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1790919488.460133:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:3.0:1790919488.460139:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958187136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919488.460163:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958187136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.460170:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00080000:3.0:1790919488.460214:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919488.460220:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1790919488.469130:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00000020:00000080:2.0:1790919488.469139:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f3b65b7000/a0eadf68-44c6-442a-b15d-9a125194f9a5 00000020:00000080:3.0:1790919488.469259:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b7000/a0eadf68-44c6-442a-b15d-9a125194f9a5 for lustre-OST0001 00000020:00000080:3.0:1790919488.469307:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65b5000 for lustre-OST0001 00000100:00100000:3.0:1790919488.924400:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919488.924423:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978187776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919488.924498:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.924547:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187776 00000100:00100000:3.0:1790919488.924554:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187776 00000100:00100000:3.0:1790919488.924607:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790919488.924617:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978187776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919488.924654:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919488.924698:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978187776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.924706:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790919488.924727:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919488.924758:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d87100 x1877914978187776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919488.924790:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978187776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790919488.927403:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919488.929609:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978187904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919488.929678:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919488.929735:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978187904 00000100:00100000:3.0:1790919488.929742:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978187904 00000100:00100000:3.0:1790919488.929808:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919488.929818:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978187904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919488.929840:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919488.929884:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978187904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919488.929891:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790919488.929989:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790919488.930020:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f286d87100 x1877914978187904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919488.930151:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978187904:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790919489.812580:0:12931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790919489.950539:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919490.460670:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978188032:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.460749:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919490.460801:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978188544:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.460829:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919490.460857:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919490.460864:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978188160:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.460888:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919490.460932:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978188416:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.460941:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978188288:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.460972:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919490.461005:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188288 00000100:00100000:0.0:1790919490.461013:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188288 00000100:00100000:0.0:1790919490.461091:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790919490.461101:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978188288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.461295:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978188672:0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.461326:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919490.461346:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978189184:0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.461367:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919490.461386:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790919490.461391:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978189056:0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.461416:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919490.461433:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978189568:0@lo:400:kworker.0 00000100:00100000:1.0:1790919490.461575:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188032 00000100:00100000:1.0:1790919490.461592:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188032 00000100:00100000:1.0:1790919490.461622:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1790919490.461630:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978188032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919490.461668:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978188032:12345-0@lo:400:kworker.0 Request processed in 39us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919490.461675:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790919490.462029:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919490.462128:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978188928:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462157:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919490.462177:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978189440:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462199:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919490.462218:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790919490.462391:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978188800:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462422:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919490.462449:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978189312:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.462452:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978188288:12345-0@lo:400:kworker.0 Request processed in 1350us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919490.462463:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790919490.462481:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919490.462485:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188416 00000100:00100000:0.0:1790919490.462492:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188416 00000100:00100000:3.0:1790919490.462513:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188544 00000100:00100000:0.0:1790919490.462518:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790919490.462519:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188544 00000100:00100000:0.0:1790919490.462529:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978188416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462548:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188160 00000100:00100000:3.0:1790919490.462552:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188160 00000100:00100000:3.0:1790919490.462568:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188672 00000100:00100000:3.0:1790919490.462570:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188672 00000100:00100000:0.0:1790919490.462584:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978188416:12345-0@lo:400:kworker.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919490.462592:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790919490.462596:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189184 00000100:00100000:3.0:1790919490.462600:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189184 00000100:00100000:3.0:1790919490.462617:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188800 00000100:00100000:3.0:1790919490.462619:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188800 00000100:00100000:0.0:1790919490.462636:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978188288:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462647:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189312 00000100:00100000:3.0:1790919490.462651:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189312 00000100:00100000:3.0:1790919490.462670:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790919490.462676:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978188032:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462681:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978188544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462743:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978188544:12345-0@lo:400:kworker.0 Request processed in 65us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.462750:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790919490.462774:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790919490.462781:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978188160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462850:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978188160:12345-0@lo:400:kworker.0 Request processed in 68us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.462857:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790919490.462872:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790919490.462879:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978188672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.462897:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978188544:0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.462971:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978188160:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.462975:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978188672:12345-0@lo:400:kworker.0 Request processed in 96us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.462982:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790919490.462997:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790919490.463002:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978189184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919490.463012:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978188416:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.463027:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978189184:12345-0@lo:400:kworker.0 Request processed in 25us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.463032:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790919490.463040:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790919490.463044:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978188800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.463091:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978188800:12345-0@lo:400:kworker.0 Request processed in 46us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.463098:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790919490.463109:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790919490.463115:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978189312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.463310:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790919490.463339:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919490.463345:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919490.463349:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978188672:0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.463365:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978189184:0@lo:400:kworker.0 00000100:00100000:2.0:1790919490.463408:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189056 00000100:00100000:2.0:1790919490.463413:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189056 00000100:00100000:3.0:1790919490.463461:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978189312:12345-0@lo:400:kworker.0 Request processed in 345us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.463469:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790919490.463513:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978188928 00000100:00100000:3.0:1790919490.463517:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978188928 00000100:00100000:3.0:1790919490.463540:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189440 00000100:00100000:3.0:1790919490.463543:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189440 00000100:00100000:3.0:1790919490.463574:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189568 00000100:00100000:3.0:1790919490.463577:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189568 00000100:00100000:3.0:1790919490.463597:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919490.463604:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978188928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.463645:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978188928:12345-0@lo:400:kworker.0 Request processed in 43us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.463656:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919490.463669:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790919490.463675:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978189440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.463705:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978189440:12345-0@lo:400:kworker.0 Request processed in 31us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.463710:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790919490.463720:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790919490.463726:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978189568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.463753:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978189568:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.463771:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790919490.463820:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919490.463832:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978189696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919490.463865:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790919490.463903:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54aa00 x1877914978188800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919490.463915:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978188800:0@lo:400:kworker.0 00010000:00080000:1.0:1790919490.463967:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebf100 x1877914978189312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919490.463976:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978189312:0@lo:400:kworker.0 00010000:00080000:1.0:1790919490.464024:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54a300 x1877914978188928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919490.464030:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189696 00000100:00100000:1.0:1790919490.464035:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978188928:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.464036:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189696 00000100:00100000:3.0:1790919490.464102:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790919490.464118:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978189696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919490.464126:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00002000:00000024:3.0:1790919490.464146:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919490.464185:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978189696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.464191:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919490.464213:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978189056:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790919490.464224:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac3800 x1877914978189696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919490.464242:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978189696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919490.464262:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978189056:12345-0@lo:400:kworker.0 Request processed in 53us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919490.464270:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1790919490.464278:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919490.464284:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919490.464288:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978189824:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790919490.464315:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebd180 x1877914978189056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919490.464335:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919490.464346:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978189056:0@lo:400:kworker.0 00010000:00080000:3.0:1790919490.464365:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebed80 x1877914978189568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919490.464374:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978189568:0@lo:400:kworker.0 00000100:00100000:3.0:1790919490.464400:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189824 00000100:00100000:3.0:1790919490.464404:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189824 00000100:00100000:3.0:1790919490.464428:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790919490.464435:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978189824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919490.464446:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919490.464482:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978189824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919490.464489:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1790919490.464515:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac1f80 x1877914978189824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919490.464533:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978189824:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1790919490.465769:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebf480 x1877914978189440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919490.465787:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978189440:0@lo:400:kworker.0 00010000:00010000:3.0:1790919490.972679:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919491.996973:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919492.922129:0:13030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:38:12 (1790919492) === 00010000:00010000:3.0:1790919493.021609:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919493.085846:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.085887:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.085926:0:6455:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958187392 00000100:00100000:2.0:1790919493.085938:0:6455:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958187392 00000100:00100000:2.0:1790919493.086006:0:6455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790919493.086018:0:6455:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:10615:x1877914958187392:12345-192.168.203.11@tcp:700:mkdir.0 00000100:00100000:2.0:1790919493.086220:0:6455:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:10615:x1877914958187392:12345-192.168.203.11@tcp:700:mkdir.0 Request processed in 128us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919493.086230:0:6455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00080000:2.0:1790919493.086258:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919493.086309:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958187264 00000100:00100000:0.0:1790919493.086315:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958187264 00000100:00100000:0.0:1790919493.086351:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919493.086359:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958187264:12345-192.168.203.11@tcp:41:mkdir.0 00000004:00000024:0.0:1790919493.086397:0:6446:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919493.087081:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958187264:12345-192.168.203.11@tcp:41:mkdir.0 Request processed in 719us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919493.087093:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1790919493.091576:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.091619:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958187648 00000100:00100000:2.0:1790919493.091632:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958187648 00000100:00100000:2.0:1790919493.091697:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1790919493.091708:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:10615:x1877914958187648:12345-192.168.203.11@tcp:36:mkdir.0 00010000:00010000:2.0:1790919493.091794:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919493.091827:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913605 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b0c expref: 6 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.091850:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5200) 00010000:00010000:2.0:1790919493.091935:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919493.092448:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.092468:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.092491:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.092658:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.093804:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.093817:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096185:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096206:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096217:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919493.096243:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ffb5ab7f reply state 00000000da953a7a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096255:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096263:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3930c1400) 00010000:00010000:2.0:1790919493.096266:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919493.096271:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790919493.096276:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919493.096285:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096303:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096311:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096318:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919493.096323:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096488:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096500:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:2.0:1790919493.096503:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919493.096507:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096514:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913763 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919493.096534:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ffb5ab7f reply state 00000000da953a7a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096543:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.096549:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95f3930c1100) 00010000:00010000:2.0:1790919493.096552:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919493.096554:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790919493.096660:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:10615:x1877914958187648:12345-192.168.203.11@tcp:36:mkdir.0 Request processed in 4949us (5095us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790919493.096827:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790919493.110624:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919493.110863:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958187776 00000100:00100000:0.0:1790919493.110878:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958187776 00000100:00100000:0.0:1790919493.110972:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1790919493.110986:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:10616:x1877914958187776:12345-192.168.203.11@tcp:101:chmod.0 00010000:00010000:0.0:1790919493.111011:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919493.111039:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38b9f expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.111311:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591377f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.111334:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591377f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.111349:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591377f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919493.111404:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919493.111409:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919493.111455:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591377f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.111497:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b9f expref: 9 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.111521:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591377f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b9f expref: 8 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.111540:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:1.0:1790919493.111543:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919493.111547:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487c00, rc 0) 00000100:00100000:1.0:1790919493.111669:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:10616:x1877914958187776:12345-192.168.203.11@tcp:101:chmod.0 Request processed in 687us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919493.111680:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790919493.118556:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919493.118667:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958188032 00000100:00100000:0.0:1790919493.118682:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958188032 00000100:00100000:0.0:1790919493.118788:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790919493.118800:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:10616:x1877914958188032:12345-192.168.203.11@tcp:36:chmod.0 00010000:00010000:0.0:1790919493.118870:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919493.118908:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591377f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b9f expref: 8 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.118929:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:0.0:1790919493.118959:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919493.119010:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.119027:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.119039:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919493.119767:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000068c712d0 reply state 00000000bba81426 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.119785:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.119794:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:0.0:1790919493.119797:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790919493.119800:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790919493.119812:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790919493.119923:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:10616:x1877914958188032:12345-192.168.203.11@tcp:36:chmod.0 Request processed in 1124us (1379us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790919493.119932:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790919493.140105:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.140385:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958188160 00000100:00100000:2.0:1790919493.140399:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958188160 00000100:00100000:2.0:1790919493.140477:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1790919493.140489:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:10617:x1877914958188160:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:2.0:1790919493.140527:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919493.140559:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591378d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ba6 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.140645:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913794 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.140662:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.140674:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919493.140717:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919493.140720:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919493.140774:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.140865:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591378d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ba6 expref: 11 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.140890:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913794 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ba6 expref: 10 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.140923:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:2.0:1790919493.140926:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919493.140931:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697800, rc 0) 00000100:00100000:2.0:1790919493.141011:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:10617:x1877914958188160:12345-192.168.203.11@tcp:101:chown.0 Request processed in 524us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919493.141019:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790919493.146855:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.146941:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958188288 00000100:00100000:1.0:1790919493.146954:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958188288 00000100:00100000:1.0:1790919493.147026:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790919493.147039:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:10617:x1877914958188288:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:1.0:1790919493.147112:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919493.147364:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591379b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bad expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147459:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147478:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147510:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147524:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147531:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147539:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147657:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159137b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147666:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159137b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147674:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159137b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919493.147714:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919493.147718:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919493.147755:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159137b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147769:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147777:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147803:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147810:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919493.147815:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147824:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147838:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:0.0:1790919493.147841:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919493.147847:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147854:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159137a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147871:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147877:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147882:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147888:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919493.147890:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147907:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147915:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95f3930c1100) 00010000:00010000:0.0:1790919493.147917:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919493.147921:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147926:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159137a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147960:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591379b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bad expref: 12 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147975:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159137b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bad expref: 11 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.147982:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3930c1400) 00010000:00010000:0.0:1790919493.147984:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919493.147987:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014e00, rc 0) 00000100:00100000:0.0:1790919493.148111:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:10617:x1877914958188288:12345-192.168.203.11@tcp:101:chown.0 Request processed in 1074us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919493.148120:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790919493.152645:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.152788:0:6456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958188416 00000100:00100000:1.0:1790919493.152800:0:6456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958188416 00000100:00100000:1.0:1790919493.152910:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919493.152922:0:6456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:10617:x1877914958188416:12345-192.168.203.11@tcp:900:chown.0 00000100:00100000:1.0:1790919493.153040:0:6456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:10617:x1877914958188416:12345-192.168.203.11@tcp:900:chown.0 Request processed in 120us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919493.153079:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790919493.162845:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919493.163522:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958188672 00000100:00100000:0.0:1790919493.163585:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958188672 00000100:00100000:0.0:1790919493.163773:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1790919493.163787:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:10617:x1877914958188672:12345-192.168.203.11@tcp:36:chown.0 00010000:00010000:0.0:1790919493.163877:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919493.163913:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159137b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bad expref: 11 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.163937:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3930c1400) 00010000:00010000:0.0:1790919493.163943:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919493.163974:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.163992:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.164003:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919493.218100:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045cc85ef reply state 0000000055719486 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.218153:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.218166:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3930c1400) 00010000:00010000:2.0:1790919493.218169:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790919493.218175:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790919493.218194:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790919493.218336:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:10617:x1877914958188672:12345-192.168.203.11@tcp:36:chown.0 Request processed in 54548us (55502us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790919493.218345:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000001:00080000:1.0:1790919493.218482:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1790919493.218670:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218683:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218694:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218701:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204a000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.218708:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218718:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218732:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95f3930c1100) 00010000:00010000:3.0:1790919493.218735:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919493.218750:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218757:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a000/0x951c50ad1591376a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218803:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218810:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218816:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218822:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204a400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.218825:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218831:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218840:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3930c1400) 00010000:00010000:3.0:1790919493.218843:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919493.218846:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218852:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913771 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218865:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218871:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218877:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218890:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.218893:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218899:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218908:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919493.218911:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919493.218914:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218920:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913786 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218932:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218939:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218944:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.218949:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.219776:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.219788:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.219817:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3930c1400) 00010000:00010000:3.0:1790919493.219820:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919493.219824:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.219831:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad159137b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919493.244690:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919493.249352:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958188800 00000100:00100000:0.0:1790919493.249373:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958188800 00000100:00100000:2.0:1790919493.251016:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1790919493.251035:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:10618:x1877914958188800:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:2.0:1790919493.251395:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919493.251427:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159137be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bb4 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919493.254285:0:7785:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2748us 00010000:00010000:3.0:1790919493.270728:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.270770:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.270785:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.270804:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.270813:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.270820:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272439:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2ce00/0x951c50ad159137d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272461:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2ce00/0x951c50ad159137d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272481:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2ce00/0x951c50ad159137d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919493.272520:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919493.272525:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919493.272576:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2ce00/0x951c50ad159137d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272592:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272601:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272610:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272617:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.272622:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272633:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272647:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919493.272650:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919493.272655:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272663:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272687:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272693:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272699:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272705:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.272709:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272715:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272724:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95f3904a5e00) 00010000:00010000:3.0:1790919493.272726:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919493.272730:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272735:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272798:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159137be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bb4 expref: 8 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272817:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2ce00/0x951c50ad159137d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bb4 expref: 7 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.272838:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:3.0:1790919493.272841:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790919493.272844:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2ce00, rc 0) 00000100:00100000:3.0:1790919493.273215:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:10618:x1877914958188800:12345-192.168.203.11@tcp:101:touch.500 Request processed in 22181us (28543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919493.273226:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1790919493.281173:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919493.281387:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958189056 00000100:00100000:3.0:1790919493.281402:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958189056 00000100:00100000:3.0:1790919493.281476:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:3.0:1790919493.281487:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:10618:x1877914958189056:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:3.0:1790919493.281517:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919493.281543:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bbb expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.281912:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.281931:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.281943:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.281961:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.281969:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.281989:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919493.286846:0:6447:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1790919493.289594:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad159137ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289627:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad159137ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289642:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad159137ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289691:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289698:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289706:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289712:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919493.289718:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289727:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289800:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:3.0:1790919493.289805:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919493.289827:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289834:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad159137e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919493.289849:0:6447:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000904219ea reply state 000000002b7af55b transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289861:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289868:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x88f20065 (ffff95f3904a5e00) 00010000:00010000:3.0:1790919493.289871:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919493.289874:0:6447:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790919493.289922:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad159137da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bbb expref: 10 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289938:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad159137ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bbb expref: 9 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.289945:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3904a5500) 00010000:00010000:3.0:1790919493.289948:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919493.289950:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2dc00, rc 0) 00000100:00100000:3.0:1790919493.290074:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:10618:x1877914958189056:12345-192.168.203.11@tcp:101:touch.500 Request processed in 8564us (8891us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790919493.290085:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790919493.296568:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.296783:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958189312 00000100:00100000:2.0:1790919493.296797:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958189312 00000100:00100000:2.0:1790919493.296886:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790919493.296898:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:10618:x1877914958189312:12345-192.168.203.11@tcp:36:touch.500 00010000:00010000:2.0:1790919493.296976:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919493.297008:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad159137ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bbb expref: 10 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.297031:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3904a5500) 00010000:00010000:2.0:1790919493.297045:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919493.297144:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.297410:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.297426:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919493.297613:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f5c1c679 reply state 00000000377e194d transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.297625:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.297631:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:2.0:1790919493.297634:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919493.297637:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919493.297794:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:10618:x1877914958189312:12345-192.168.203.11@tcp:36:touch.500 Request processed in 897us (1249us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790919493.297802:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790919493.303458:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919493.303575:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958189440 00000100:00100000:3.0:1790919493.303590:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958189440 00000100:00100000:3.0:1790919493.303672:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1790919493.303685:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:10618:x1877914958189440:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:3.0:1790919493.303735:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919493.303774:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913804 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bc2 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.303856:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bc2 expref: 12 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.303874:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bc2 expref: 12 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.303899:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:3.0:1790919493.303903:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919493.303907:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2de00, rc 0) 00000100:00100000:3.0:1790919493.304005:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:10618:x1877914958189440:12345-192.168.203.11@tcp:101:touch.500 Request processed in 322us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919493.304015:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1790919493.311544:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.311706:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958189568 00000100:00100000:2.0:1790919493.311719:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958189568 00000100:00100000:2.0:1790919493.311787:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790919493.311798:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958189568:12345-192.168.203.11@tcp:8:touch.500 00010000:00080000:2.0:1790919493.311846:0:8248:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1790919493.312364:0:8248:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad1591380b 00002000:00100000:2.0:1790919493.312384:0:8248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fd078e75-25ee-44fe-89dc-39e9cfa5e4b5/ffff95f3b65b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919493.312416:0:8248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919493.312711:0:8248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790919493.312764:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919493.312988:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958189568:12345-192.168.203.11@tcp:8:touch.500 Request processed in 1060us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919493.313001:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790919493.322888:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919493.322951:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958189696 00000100:00100000:3.0:1790919493.322965:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958189696 00000100:00080000:2.0:1790919493.323270:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919493.324340:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790919493.324365:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958189696:12345-192.168.203.11@tcp:2:touch.500 00000100:00100000:1.0:1790919493.403223:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:0:x1877914958189696:12345-192.168.203.11@tcp:2:touch.500 Request processed in 78853us (80334us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790919493.403244:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000001:00080000:2.0:1790919493.405105:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1790919493.405128:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000100:00100000:0.0:1790919493.410016:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.410304:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958189952 00000100:00100000:1.0:1790919493.410335:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958189952 00000100:00100000:1.0:1790919493.410412:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1790919493.410425:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:10618:x1877914958189952:12345-192.168.203.11@tcp:35:touch.500 00000100:00100000:1.0:1790919493.411106:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:10618:x1877914958189952:12345-192.168.203.11@tcp:35:touch.500 Request processed in 679us (1099us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790919493.411117:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790919493.424573:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919493.424698:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958190080 00000100:00100000:3.0:1790919493.424712:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958190080 00000100:00100000:3.0:1790919493.424900:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790919493.424912:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:10619:x1877914958190080:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1790919493.424951:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919493.425005:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bc9 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.425427:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913819 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.425445:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.425459:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919493.425505:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919493.425509:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919493.425570:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913819 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.425667:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bc9 expref: 15 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.425690:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913819 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bc9 expref: 14 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.425699:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:0.0:1790919493.425702:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919493.425707:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919493.425899:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:10619:x1877914958190080:12345-192.168.203.11@tcp:101:rm.0 Request processed in 989us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919493.425907:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1790919493.429479:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919493.429580:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958190336 00000100:00100000:0.0:1790919493.429593:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958190336 00000100:00100000:0.0:1790919493.429686:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1790919493.429698:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:10619:x1877914958190336:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1790919493.429729:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919493.429768:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bd0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919493.429900:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790919493.430550:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913820 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bd0 expref: 16 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.430567:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:1.0:1790919493.430570:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919493.430574:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bd0 expref: 16 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.430588:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015e00, rc 0) 00000100:00100000:1.0:1790919493.430662:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:10619:x1877914958190336:12345-192.168.203.11@tcp:101:rm.0 Request processed in 966us (1200us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1790919493.430675:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1790919493.437311:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.437818:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958190464 00000100:00100000:1.0:1790919493.437846:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958190464 00000100:00100000:1.0:1790919493.437927:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790919493.437939:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:10619:x1877914958190464:12345-192.168.203.11@tcp:37:rm.0 00000100:00100000:1.0:1790919493.443713:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:10619:x1877914958190464:12345-192.168.203.11@tcp:37:rm.0 Request processed in 5759us (6399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919493.443734:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790919493.450659:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.450875:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958190720 00000100:00100000:1.0:1790919493.450908:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958190720 00000100:00100000:1.0:1790919493.451122:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790919493.451137:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390323450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:10619:x1877914958190720:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:1.0:1790919493.451474:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390323450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:10619:x1877914958190720:12345-192.168.203.11@tcp:35:rm.0 Request processed in 340us (832us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790919493.451483:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919493.461625:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.461750:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958190976 00000100:00100000:1.0:1790919493.461766:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958190976 00000100:00100000:1.0:1790919493.461852:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790919493.461868:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:10619:x1877914958190976:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1790919493.461903:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919493.461930:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487600/0x951c50ad1591382e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bd7 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.462123:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487800/0x951c50ad15913835 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.462157:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487800/0x951c50ad15913835 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.462172:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487800/0x951c50ad15913835 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919493.462187:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790919493.462423:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487600/0x951c50ad1591382e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bd7 expref: 19 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.462446:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487800/0x951c50ad15913835 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bd7 expref: 18 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.462469:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:1.0:1790919493.462472:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919493.462478:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6487800, rc 0) 00000100:00100000:1.0:1790919493.462762:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958190976:12345-192.168.203.11@tcp:101:rm.0 Request processed in 899us (1153us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790919493.462772:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1790919493.467272:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.467690:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958191104 00000100:00100000:2.0:1790919493.467706:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958191104 00000100:00100000:2.0:1790919493.467917:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1790919493.467931:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958191104:12345-192.168.203.11@tcp:41:rm.0 00000004:00000024:2.0:1790919493.468025:0:6447:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1790919493.468306:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958191104:12345-192.168.203.11@tcp:41:rm.0 Request processed in 377us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919493.468315:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1790919493.478627:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.478742:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958191232 00000100:00100000:1.0:1790919493.478769:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958191232 00000100:00100000:1.0:1790919493.479028:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790919493.479040:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958191232:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1790919493.479108:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919493.479253:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487600/0x951c50ad15913843 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bde expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479340:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479357:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479370:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479382:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479390:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479419:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479539:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479547:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479554:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919493.479585:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790919493.479589:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919493.479607:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479619:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479628:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479635:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479643:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479650:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6487c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919493.479655:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479668:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479682:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:1.0:1790919493.479685:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919493.479691:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479698:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487c00/0x951c50ad1591384a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479713:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479719:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479725:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479730:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6486c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919493.479733:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479753:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479759:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x88f20065 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919493.479761:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919493.479764:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479838:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486c00/0x951c50ad15913851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479870:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487600/0x951c50ad15913843 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bde expref: 20 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479885:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bde expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919493.479892:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:1.0:1790919493.479895:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919493.479898:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6486e00, rc 0) 00000100:00100000:1.0:1790919493.480147:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:10619:x1877914958191232:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1108us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919493.480155:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790919493.487574:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919493.487682:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958191488 00000100:00100000:2.0:1790919493.487698:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958191488 00000100:00100000:2.0:1790919493.487804:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790919493.487817:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:10619:x1877914958191488:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1790919493.487911:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790919493.487954:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6486e00/0x951c50ad15913858 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bde expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.487997:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913804 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bc2 expref: 18 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488010:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:2.0:1790919493.488021:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913819 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bc9 expref: 17 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488032:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:2.0:1790919493.488035:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919493.488107:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488160:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488171:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488184:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488191:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488206:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488340:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488349:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.488356:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919493.489526:0:10757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790919493.489542:0:10757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302517488844ns, next at 303517485372ns, rc = 0 00010000:00010000:2.0:1790919493.489647:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489665:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489692:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489702:0:10757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489709:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489716:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489757:0:10757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919493.489788:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489796:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489803:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489810:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919493.489816:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489826:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489838:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:2.0:1790919493.489842:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790919493.489855:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489862:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591386d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489889:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489895:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489901:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489907:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919493.489909:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489916:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489923:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:2.0:1790919493.489925:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919493.489928:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489935:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad1591385f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919493.489948:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000612c838f reply state 0000000093dbc4a4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489972:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.489979:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x88f20065 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919493.489981:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919493.489985:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919493.490135:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958191488:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2316us (2571us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790919493.490145:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00010000:00010000:0.0:1790919493.490906:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919493.490917:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.490935:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204a400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919493.490939:0:7708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.490947:0:7708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.490960:0:7708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:0.0:1790919493.490962:0:7708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790919493.490965:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.490971:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204a400/0x951c50ad15913874 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919493.490986:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919493.490988:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919493.490990:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919493.499627:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.499725:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958191744 00000100:00100000:1.0:1790919493.499749:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958191744 00000100:00100000:1.0:1790919493.499883:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790919493.499901:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958191744:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:1.0:1790919493.500529:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:10619:x1877914958191744:12345-192.168.203.11@tcp:35:rm.0 Request processed in 626us (921us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790919493.500541:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1790919493.504084:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919493.504179:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192000 00000100:00100000:3.0:1790919493.504325:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192000 00000100:00100000:3.0:1790919493.504408:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1790919493.504421:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:10619:x1877914958192000:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1790919493.504515:0:6447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790919493.504552:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6487800/0x951c50ad15913835 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bd7 expref: 19 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504581:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2ce00/0x951c50ad159137d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bb4 expref: 18 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504594:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5600) 00010000:00010000:3.0:1790919493.504612:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913794 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ba6 expref: 17 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504623:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919493.504632:0:6447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919493.504664:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504680:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504692:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504731:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504749:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.504757:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.506386:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.506413:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919493.506426:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919493.507971:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919493.507999:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508010:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508018:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508025:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919493.508031:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508040:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508438:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:2.0:1790919493.508445:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790919493.508464:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508473:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913889 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508507:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508514:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508521:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508525:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919493.508528:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508536:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508545:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5f00) 00010000:00010000:2.0:1790919493.508547:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919493.508549:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508555:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d600/0x951c50ad1591387b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919493.508568:0:6447:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009682db50 reply state 00000000d3d8de3a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508595:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919493.508603:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95f3904a5b00) 00010000:00010000:2.0:1790919493.508606:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919493.508610:0:6447:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919493.508794:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:10619:x1877914958192000:12345-192.168.203.11@tcp:36:rm.0 Request processed in 4370us (4748us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790919493.508805:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1790919493.532522:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978190080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919493.532623:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919493.532730:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190080 00000100:00100000:3.0:1790919493.532754:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190080 00000100:00100000:3.0:1790919493.532812:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790919493.532823:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978190080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919493.532876:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919493.532930:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978190080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919493.532938:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790919493.532998:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978190080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919493.533262:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978189952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919493.533304:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919493.534339:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978189952 00000100:00100000:2.0:1790919493.534351:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978189952 00000100:00100000:2.0:1790919493.534413:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790919493.534428:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978189952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919493.534460:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919493.534542:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978189952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919493.534549:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790919493.534654:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978189952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919493.586144:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919493.586245:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192128 00000100:00100000:3.0:1790919493.586260:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192128 00000100:00100000:3.0:1790919493.586323:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:3.0:1790919493.586335:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958192128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919493.586444:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958192128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919493.586452:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:1.0:1790919493.594516:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.594620:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.594653:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.595511:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.595582:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919493.595632:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192512 00000100:00100000:1.0:1790919493.595646:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192512 00000100:00100000:0.0:1790919493.595856:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192384 00000100:00100000:0.0:1790919493.595862:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192384 00000100:00100000:0.0:1790919493.595929:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192640 00000100:00100000:0.0:1790919493.595933:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192640 00000100:00100000:0.0:1790919493.595952:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192256 00000100:00100000:0.0:1790919493.595954:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192256 00000100:00100000:0.0:1790919493.595965:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192768 00000100:00100000:0.0:1790919493.595967:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192768 00000100:00100000:0.0:1790919493.595986:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:0.0:1790919493.595996:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958192384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919493.596262:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958192384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 264us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919493.596288:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:0.0:1790919493.596315:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:0.0:1790919493.596323:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958192640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919493.596356:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958192640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919493.596363:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:0.0:1790919493.596377:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:0.0:1790919493.596384:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2412:x1877914958192256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919493.597269:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1790919493.597286:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958192512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919493.597347:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958192512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919493.597355:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1790919493.597389:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:0.0:1790919493.597509:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2412:x1877914958192256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1125us (2854us total) trans 0 rc 0/0 00000100:00080000:2.0:1790919493.597590:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919493.597596:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919493.598102:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958192768:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919493.598162:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958192768:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919493.598248:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:1.0:1790919493.603293:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 174 00010000:00010000:2.0:1790919494.044246:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919494.044366:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978190208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919494.044464:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919494.046534:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978190336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919494.046654:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919494.048421:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190208 00000100:00100000:3.0:1790919494.048446:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190208 00000100:00100000:2.0:1790919494.048473:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190336 00000100:00100000:2.0:1790919494.048480:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190336 00000100:00080000:0.0:1790919494.048538:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919494.048603:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790919494.048616:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978190208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919494.048649:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919494.048748:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978190208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919494.048756:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1790919494.048811:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bbfd5180 x1877914978190208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919494.048838:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978190208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919494.049021:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790919494.049029:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978190336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919494.049042:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919494.049115:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978190336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (2460us total) trans 0 rc 0/0 00010000:00080000:0.0:1790919494.049156:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac3800 x1877914978190336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919494.049174:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790919494.049184:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978190336:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790919495.072039:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919495.584044:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978190848:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584143:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584191:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978191360:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584219:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584252:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978191872:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584278:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584306:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1790919495.584313:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978190464:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584342:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584365:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978190976:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584409:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584427:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978191488:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584464:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584479:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978192000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584501:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584526:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978190720:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584548:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584566:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978191232:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584588:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584604:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978191744:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584625:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584644:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790919495.584649:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978190592:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584672:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584688:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978191104:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584708:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584733:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978191616:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584754:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919495.584788:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190976 00000100:00100000:0.0:1790919495.584797:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190976 00000100:00100000:0.0:1790919495.584834:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191232 00000100:00100000:0.0:1790919495.584838:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191232 00000100:00100000:0.0:1790919495.584858:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191744 00000100:00100000:0.0:1790919495.584860:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191744 00000100:00100000:0.0:1790919495.584872:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190592 00000100:00100000:0.0:1790919495.584874:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190592 00000100:00100000:0.0:1790919495.584883:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191104 00000100:00100000:0.0:1790919495.584885:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191104 00000100:00100000:0.0:1790919495.584895:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191616 00000100:00100000:0.0:1790919495.584897:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191616 00000100:00100000:0.0:1790919495.584912:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790919495.584919:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978190976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.584970:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978190976:12345-0@lo:400:kworker.0 Request processed in 51us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919495.584978:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790919495.584994:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790919495.585000:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978191232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585032:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978191232:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919495.585038:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790919495.585048:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790919495.585075:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978191744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585100:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978191744:12345-0@lo:400:kworker.0 Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919495.585105:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790919495.585115:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790919495.585119:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978190592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585151:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978190592:12345-0@lo:400:kworker.0 Request processed in 31us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919495.585157:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790919495.585169:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790919495.585175:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978191104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585199:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978191104:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919495.585205:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790919495.585215:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790919495.585221:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978191616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585245:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978191616:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919495.585249:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1790919495.585266:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919495.585270:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919495.585295:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978190976:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585324:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978190592:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585334:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978191104:0@lo:400:kworker.0 00000100:00100000:0.0:1790919495.585343:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978191616:0@lo:400:kworker.0 00010000:00080000:0.0:1790919495.585354:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f391517480 x1877914978191232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919495.585364:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978191232:0@lo:400:kworker.0 00010000:00080000:0.0:1790919495.585373:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc235c00 x1877914978191744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919495.585388:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978191744:0@lo:400:kworker.0 00000100:00100000:3.0:1790919495.587072:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190464 00000100:00100000:3.0:1790919495.587085:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190464 00000100:00100000:3.0:1790919495.587134:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790919495.587142:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978190464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919495.587224:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978190464:12345-0@lo:400:kworker.0 Request processed in 83us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.587231:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790919495.587262:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191360 00000100:00100000:3.0:1790919495.587266:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191360 00000100:00100000:3.0:1790919495.587284:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191872 00000100:00100000:3.0:1790919495.587287:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191872 00000100:00100000:3.0:1790919495.587307:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978191488 00000100:00100000:3.0:1790919495.587310:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978191488 00000100:00100000:3.0:1790919495.587319:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192000 00000100:00100000:3.0:1790919495.587322:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192000 00000100:00100000:3.0:1790919495.587336:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919495.587342:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978191360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919495.587374:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978191360:12345-0@lo:400:kworker.0 Request processed in 32us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.587380:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919495.587393:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790919495.587399:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978191872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919495.587430:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978191872:12345-0@lo:400:kworker.0 Request processed in 31us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.587548:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790919495.587562:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790919495.587569:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978191488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919495.587603:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978191488:12345-0@lo:400:kworker.0 Request processed in 35us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.587609:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790919495.587620:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919495.587634:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978192000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919495.587668:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978192000:12345-0@lo:400:kworker.0 Request processed in 35us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.587674:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919495.587854:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978190464:0@lo:400:kworker.0 00010000:00080000:3.0:1790919495.587871:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc237100 x1877914978191488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919495.587884:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978191488:0@lo:400:kworker.0 00010000:00080000:3.0:1790919495.587895:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc235f80 x1877914978192000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919495.587905:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978192000:0@lo:400:kworker.0 00010000:00080000:3.0:1790919495.587918:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f391515500 x1877914978191360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919495.587926:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978191360:0@lo:400:kworker.0 00010000:00080000:3.0:1790919495.587937:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc234700 x1877914978191872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919495.587945:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978191872:0@lo:400:kworker.0 00000100:00080000:3.0:1790919495.587978:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919495.587993:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919495.588027:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919495.588074:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919495.588080:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978192128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919495.588104:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919495.588645:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192256 00000100:00100000:3.0:1790919495.588652:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192256 00000100:00100000:3.0:1790919495.588691:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192128 00000100:00100000:3.0:1790919495.588694:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192128 00000100:00100000:3.0:1790919495.588709:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919495.588716:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978192256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919495.588760:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919495.588885:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978192256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.588892:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919495.588908:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790919495.588914:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978192128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919495.588925:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919495.588949:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978192128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919495.588955:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1790919495.588989:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bbfd5180 x1877914978192128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919495.589005:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978192128:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790919495.589017:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bce00 x1877914978192256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919495.589027:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919495.589646:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190848 00000100:00100000:2.0:1790919495.589654:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190848 00000100:00100000:2.0:1790919495.589686:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978190720 00000100:00100000:2.0:1790919495.589689:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978190720 00000100:00100000:2.0:1790919495.589730:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790919495.589738:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978190848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919495.589803:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978190848:12345-0@lo:400:kworker.0 Request processed in 65us (5660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919495.589809:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790919495.589824:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790919495.589829:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978190720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919495.589863:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978190720:12345-0@lo:400:kworker.0 Request processed in 33us (5314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919495.589869:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790919495.589916:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978190848:0@lo:400:kworker.0 00000100:00100000:2.0:1790919495.589942:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978190720:0@lo:400:kworker.0 00010000:00010000:1.0:1790919496.096744:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919496.759969:0:13183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1790919497.116371:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790919497.741802:0:13231:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff11db9ae0 20000000:00000080:1.0:1790919497.741819:0:13231:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f287199800 uarg=0000000000000000 20000000:01000000:1.0:1790919497.741854:0:13231:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790919497.741860:0:13231:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790919497.741870:0:13231:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790919497.744831:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790919497.745033:0:13231:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790919497.754373:0:13231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790919497.754440:0:13231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790919497.754498:0:13231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790919497.754517:0:13231:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790919497.754537:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754556:0:13231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754565:0:13231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754573:0:13231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591372b expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754589:0:13231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913739 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754596:0:13231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913747 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754603:0:13231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15913755 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754611:0:13231:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754655:0:13231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913755 expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754670:0:13231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913755 expref: 23 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.754684:0:13231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192384:0@lo:104: 00000100:00100000:2.0:1790919497.754764:0:13231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919497.754827:0:13231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913747 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754836:0:13231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913747 expref: 23 pid: 6440 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.754845:0:13231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5ede300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192512:0@lo:104: 00010000:00010000:2.0:1790919497.754875:0:13231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15913739 expref: 23 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754894:0:13231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15913739 expref: 23 pid: 6438 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.754903:0:13231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5edf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192640:0@lo:104: 00010000:00010000:2.0:1790919497.754930:0:13231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591372b expref: 23 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754950:0:13231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591372b expref: 23 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.754958:0:13231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192768:0@lo:104: 00010000:00010000:2.0:1790919497.754985:0:13231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.754996:0:13231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 12 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.755005:0:13231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192896:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919497.755083:0:13231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.755093:0:13231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 12 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.755101:0:13231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978193024:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919497.755135:0:13231:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919497.755347:0:6429:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790919497.755367:0:6429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919497.755386:0:6429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919497.755394:0:6429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919497.755411:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192384 00000100:00100000:3.0:1790919497.755418:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192384 00000100:00100000:3.0:1790919497.755454:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192512 00000100:00100000:3.0:1790919497.755457:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192512 00000100:00100000:3.0:1790919497.755467:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192640 00000100:00100000:3.0:1790919497.755470:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192640 00000100:00100000:3.0:1790919497.755478:0:6429:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978192768 00000100:00100000:3.0:1790919497.755481:0:6429:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978192768 00000100:00100000:3.0:1790919497.755493:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790919497.755502:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:13231:x1877914978192384:12345-0@lo:104: 00010000:00010000:3.0:1790919497.755528:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.755577:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919497.755583:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+6:13231:x1877914978192384:12345-0@lo:104: Request processed in 83us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919497.755589:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790919497.755632:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790919497.755640:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:13231:x1877914978192512:12345-0@lo:104: 00010000:00010000:3.0:1790919497.755647:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.755688:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919497.755693:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+5:13231:x1877914978192512:12345-0@lo:104: Request processed in 55us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919497.755698:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790919497.755723:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919497.755729:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:13231:x1877914978192640:12345-0@lo:104: 00010000:00010000:3.0:1790919497.755736:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.755785:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790919497.755791:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+4:13231:x1877914978192640:12345-0@lo:104: Request processed in 63us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919497.755797:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919497.755809:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919497.755815:0:6429:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:13231:x1877914978192768:12345-0@lo:104: 00010000:00010000:3.0:1790919497.755821:0:6429:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.755845:0:6429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790919497.755850:0:6429:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+3:13231:x1877914978192768:12345-0@lo:104: Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919497.755854:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1790919497.755925:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790919497.755930:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.755949:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6487000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919497.755954:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.755963:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919497.755970:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919497.755976:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919497.756015:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756021:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919497.756039:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756046:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6487000/0x951c50ad15913755 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591375c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756073:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790919497.756077:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756083:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6487a00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919497.756086:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756092:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919497.756099:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919497.756107:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919497.756119:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756124:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919497.756130:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756145:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6487a00/0x951c50ad15913747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591374e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756152:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919497.756155:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756160:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6486000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919497.756163:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756170:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919497.756176:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919497.756181:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919497.756190:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756195:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919497.756208:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756214:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6486000/0x951c50ad15913739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913740 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756221:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919497.756229:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756235:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919497.756238:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756244:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919497.756250:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919497.756255:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919497.756264:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756270:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919497.756275:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756281:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d400/0x951c50ad1591372b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15913732 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.756293:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919497.756295:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919497.756297:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919497.756303:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919497.756310:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919497.756324:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978193152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919497.756355:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919497.756392:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919497.756399:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978193280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919497.756426:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919497.756455:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978193408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919497.756478:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919497.756619:0:13231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192384:0@lo:104: 00000100:00100000:2.0:1790919497.756634:0:13231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5ede300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192512:0@lo:104: 00000100:00100000:2.0:1790919497.756641:0:13231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5edf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192640:0@lo:104: 00000100:00100000:2.0:1790919497.756647:0:13231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192768:0@lo:104: 00000100:00100000:0.0:1790919497.756977:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193152 00000100:00100000:0.0:1790919497.756984:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193152 00010000:00010000:0.0:1790919497.757014:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913755 expref: 24 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919497.757015:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919497.757026:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978193536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919497.757049:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193280 00000100:00100000:0.0:1790919497.757073:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193280 00010000:00010000:0.0:1790919497.757087:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913747 expref: 25 pid: 6440 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.757093:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193408 00000100:00100000:2.0:1790919497.757100:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193408 00010000:00010000:2.0:1790919497.757117:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913739 expref: 26 pid: 6438 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919497.757122:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790919497.757136:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+26:3458:x1877914978193152:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919497.757144:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1790919497.757150:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790919497.757154:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1948390b-ad58-4044-9ddd-8f90f3aaa52f+26:3458:x1877914978193280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919497.757158:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913755 expref: 26 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.757165:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919497.757172:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913747 expref: 26 pid: 6440 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919497.757175:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913755 expref: 26 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919497.757273:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919497.757282:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+26:3460:x1877914978193408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919497.757290:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919497.757295:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15913739 expref: 26 pid: 6438 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919497.757333:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919497.757366:0:6432:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:3.0:1790919497.757374:0:6432:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:3.0:1790919497.757389:0:7709:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:3.0:1790919497.757395:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193536 00000100:00100000:3.0:1790919497.757398:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193536 00010000:00010000:3.0:1790919497.757410:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591372b expref: 27 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919497.757422:0:7709:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:3.0:1790919497.757427:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790919497.757432:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+27:3460:x1877914978193536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919497.757439:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919497.757443:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591372b expref: 27 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.757745:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913747 expref: 27 pid: 6440 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.757759:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204ae00/0x951c50ad1591374e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913747 expref: 27 pid: 6440 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919497.757773:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919497.757810:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1948390b-ad58-4044-9ddd-8f90f3aaa52f+26:3458:x1877914978193280:12345-0@lo:103:ldlm_bl.0 Request processed in 659us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919497.757816:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1790919497.758923:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204b200/0x951c50ad1591375c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913755 expref: 25 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.758932:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15913739 expref: 25 pid: 6438 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.758957:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015000/0x951c50ad15913740 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15913739 expref: 24 pid: 6438 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.758968:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919497.759138:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978193280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919497.759183:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919497.759239:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3460:x1877914978193408:12345-0@lo:103:ldlm_bl.0 Request processed in 1957us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919497.759248:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3458:x1877914978193152:12345-0@lo:103:ldlm_bl.0 Request processed in 2114us (2891us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919497.759257:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919497.759363:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978193408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919497.759382:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978193152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919497.759417:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1790919497.759471:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591372b expref: 21 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.759484:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014c00/0x951c50ad15913732 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591372b expref: 21 pid: 6439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919497.759493:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919497.759573:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3460:x1877914978193536:12345-0@lo:103:ldlm_bl.0 Request processed in 2140us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919497.759580:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919497.759647:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978193536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919497.769519:0:13231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978192896:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919497.769553:0:13231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13231:1877914978193024:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919497.769678:0:13231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919497.771970:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919497.772164:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919497.773445:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193024 00000100:00100000:2.0:1790919497.773471:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193024 00010000:00010000:2.0:1790919497.773511:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 13 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919497.773587:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958192896 00000100:00100000:2.0:1790919497.773591:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958192896 00010000:00010000:2.0:1790919497.773857:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 14 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919497.773902:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1790919497.773915:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+14:2414:x1877914958193024:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790919497.773928:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00010000:00010000:0.0:1790919497.773932:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919497.773942:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 14 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919497.773944:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8157f22-2e62-481b-a08b-6545627fb184+14:2414:x1877914958192896:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919497.773960:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919497.773962:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 14 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.773970:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 14 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919497.773986:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6487e00/0x951c50ad15913724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b98 expref: 14 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.773988:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 14 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919497.774007:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919497.774012:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6486400/0x951c50ad1591371d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b91 expref: 13 pid: 6439 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774026:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774034:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774049:0:6431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919497.774096:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+12:2414:x1877914958193024:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 184us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919497.774104:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00010000:00010000:1.0:1790919497.774164:0:6431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774171:0:6431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774178:0:6431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774184:0:6431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204aa00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919497.774189:0:6431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774197:0:6431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774212:0:6431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919497.774227:0:13231:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919497.774233:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919497.774239:0:13231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919497.774258:0:13231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204aa00/0x951c50ad15913890 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919497.775815:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a8157f22-2e62-481b-a08b-6545627fb184+11:2414:x1877914958192896:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1870us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919497.775829:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00010000:00010000:3.0:1790919498.140254:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919498.463096:0:13281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe30c60960 20000000:00000080:3.0:1790919498.463113:0:13281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f285a8d000 uarg=0000000000000000 20000000:01000000:3.0:1790919498.463151:0:13281:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1790919498.463157:0:13281:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1790919498.463162:0:13281:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1790919498.464293:0:13282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1790919498.466532:0:13281:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1790919498.466868:0:13281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1790919498.466912:0:13281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1790919498.466969:0:13281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1790919498.466985:0:13281:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790919498.467004:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467020:0:13281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467030:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467037:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467044:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467086:0:13281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467103:0:13281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919498.467107:0:13281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467117:0:13281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467129:0:13281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467138:0:13281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919498.467146:0:13281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2d400/0x951c50ad15913897 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919498.652529:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919498.652553:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978193664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919498.652627:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919498.652860:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193664 00000100:00100000:2.0:1790919498.652869:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193664 00000100:00100000:2.0:1790919498.652915:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919498.652926:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978193664:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919498.652959:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00000024:2.0:1790919498.652967:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919498.652971:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978193792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919498.653008:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919498.653034:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978193664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919498.653043:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919498.653083:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193792 00000100:00100000:2.0:1790919498.653087:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193792 00000100:00100000:1.0:1790919498.653099:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978193664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919498.653117:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790919498.653127:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978193792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919498.653182:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919498.653318:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978193792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 193us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919498.653325:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790919498.653436:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978193792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919498.697591:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919498.697824:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193152 00000100:00100000:1.0:1790919498.697836:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193152 00000100:00100000:0.0:1790919498.698081:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919498.698105:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919498.698258:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193280 00000100:00100000:0.0:1790919498.698263:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193280 00000100:00100000:0.0:1790919498.698299:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193408 00000100:00100000:0.0:1790919498.698302:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193408 00000100:00100000:0.0:1790919498.698323:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:0.0:1790919498.698332:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2414:x1877914958193280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919498.698430:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:0.0:1790919498.698438:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958193408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919498.698511:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958193408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919498.698518:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00080000:0.0:1790919498.698540:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919498.698544:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919498.698577:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919498.698680:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919498.698721:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919498.698739:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193536 00000100:00100000:0.0:1790919498.698750:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193536 00000100:00100000:3.0:1790919498.698772:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193792 00000100:00100000:3.0:1790919498.698779:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193792 00000100:00100000:0.0:1790919498.698790:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1790919498.698800:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958193536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919498.698813:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193664 00000100:00100000:3.0:1790919498.698818:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193664 00000100:00100000:0.0:1790919498.698838:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958193536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919498.698843:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:0.0:1790919498.698853:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1790919498.698858:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958193792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919498.698906:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958193792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919498.698914:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:0.0:1790919498.698930:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958193664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919498.698957:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958193664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919498.699091:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:1.0:1790919498.699099:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:2413:x1877914958193152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919498.699126:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+11:2413:x1877914958193152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919498.699131:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:3.0:1790919498.699431:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:0.0:1790919498.699460:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00080000:0.0:1790919498.699485:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919498.699488:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919498.699490:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919498.699670:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2414:x1877914958193280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1339us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919498.699678:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000001:00080000:2.0:1790919498.705390:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1790919498.705501:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705514:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705521:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705527:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919498.705533:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705540:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705574:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x88f20065 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919498.705577:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919498.705582:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705589:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad159137e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705608:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705626:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705632:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705637:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919498.705640:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705646:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705654:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:1.0:1790919498.705656:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919498.705659:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705665:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159137fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705695:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705711:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705717:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705723:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919498.705726:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705733:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705740:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x88f20065 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919498.705743:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919498.705746:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.705752:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913866 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x88f20065 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919498.705968:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790919498.706524:0:13296:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:0.0:1790919498.706571:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919498.706581:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919498.706588:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919498.706593:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919498.706598:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919498.706614:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919498.706624:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95f3904a5b00) 00010000:00010000:0.0:1790919498.706627:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919498.706630:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919498.706636:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913882 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919498.706936:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919498.706952:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978193920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790919498.707017:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919498.707095:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978193920 00000100:00100000:1.0:1790919498.709425:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978193920 00000100:00100000:1.0:1790919498.709518:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919498.709545:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978193920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790919498.709583:0:8083:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1790919498.709633:0:8083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6abf4346, atime: 0x6abf4346, ctime: 0x6abf4346, blocks: 0x1 00010000:00010000:1.0:1790919498.709642:0:8083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.709662:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1790919498.709667:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919498.709674:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.709692:0:8083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.709716:0:8083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.709726:0:8083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.709746:0:8083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1790919498.710141:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919498.710545:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978193920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1003us (3527us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790919498.710554:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1790919498.710580:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919498.710587:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.710607:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1ce00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919498.710612:0:7708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.710620:0:7708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.710637:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.710644:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fd3dfc2/0x951c50ad1591389e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919498.710665:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919498.710667:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919498.710669:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790919498.710904:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f3b58bc700/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790919498.710911:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978193920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790919499.164337:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919499.164362:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978194048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919499.164446:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919499.164499:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194048 00000100:00100000:0.0:1790919499.164508:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194048 00000100:00100000:0.0:1790919499.164561:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790919499.164571:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978194048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919499.164605:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919499.164648:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978194048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.164655:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1790919499.164676:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919499.164721:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978194048:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790919499.164867:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919499.165004:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978194176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919499.165037:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.165214:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194176 00000100:00100000:3.0:1790919499.165219:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194176 00000100:00100000:3.0:1790919499.165251:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919499.165258:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978194176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919499.165271:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919499.165315:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978194176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919499.165322:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790919499.165396:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978194176:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1790919499.420738:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919499.420746:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3a6ada000 from 7 10000000:01000000:1.0:1790919499.420751:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919499.420797:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.420826:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.420838:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919499.420863:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.420927:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919499.420973:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6272b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919499.421706:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194304 00000100:00100000:3.0:1790919499.421715:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194304 00000100:00100000:3.0:1790919499.421770:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1790919499.421779:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:6443:x1877914978194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919499.421792:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919499.421806:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2d400/0x951c50ad159138ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159138a5 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.421835:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2d400/0x951c50ad159138ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159138a5 expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.421844:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2d400/0x951c50ad159138ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159138a5 expref: 21 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.421852:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2d400, rc 0) 00000100:00100000:3.0:1790919499.421901:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919499.421915:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1790919499.422007:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919499.422021:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.422030:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919499.422100:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.422128:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919499.422160:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6272b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919499.422211:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194432 00000100:00100000:3.0:1790919499.422216:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194432 00000100:00100000:3.0:1790919499.422245:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1790919499.422252:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978194432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.422494:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978194432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919499.422501:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1790919499.422613:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.422642:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.422677:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919499.422706:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b6272b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919499.422748:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194560 00000100:00100000:0.0:1790919499.422754:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194560 00000100:00100000:0.0:1790919499.422787:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1790919499.422794:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978194560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.422949:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978194560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.422958:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790919499.422997:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.425851:0:13297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13297:1877914978194688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919499.425934:0:13297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.425977:0:13297:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6840 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.426087:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194688 00000100:00100000:2.0:1790919499.426096:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194688 00000100:00100000:2.0:1790919499.426144:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1790919499.426153:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:13297:x1877914978194688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919499.426382:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:13297:x1877914978194688:12345-0@lo:502:llog_process_th.0 Request processed in 230us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.426390:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1790919499.426474:0:13297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13297:1877914978194688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919499.426498:0:13297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919499.426505:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919499.426507:0:13297:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790919499.426512:0:13297:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3a6ada000 00000020:00000080:0.0:1790919499.426514:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919499.426560:0:13297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919499.426562:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919499.426563:0:13297:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790919499.426565:0:13297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919499.426566:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919499.426567:0:13297:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790919499.426569:0:13297:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3a6ada000 00000020:00000080:0.0:1790919499.426570:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790919499.426592:0:13297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13297:1877914978194816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919499.426632:0:13297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919499.426666:0:13297:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919499.427761:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194816 00000100:00100000:1.0:1790919499.427779:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194816 00000100:00100000:1.0:1790919499.427828:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790919499.427836:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:13297:x1877914978194816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919499.428031:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:13297:x1877914978194816:12345-0@lo:502:llog_process_th.0 Request processed in 195us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.428039:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1790919499.428171:0:13297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13297:1877914978194816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919499.428198:0:13297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919499.428205:0:13297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919499.428212:0:13297:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790919499.428217:0:13297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790919499.428379:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790919499.428401:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919499.428411:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.428423:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919499.428432:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919499.428435:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3be491000 from 7 10000000:01000000:1.0:1790919499.428439:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919499.428465:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.428472:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.428481:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919499.428498:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.428532:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919499.428564:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b62723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919499.429119:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978194944 00000100:00100000:3.0:1790919499.429125:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978194944 00000100:00100000:3.0:1790919499.429160:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1790919499.429167:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:6443:x1877914978194944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919499.429180:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919499.429389:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159138ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159138b3 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.429413:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159138ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159138b3 expref: 22 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.429423:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159138ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159138b3 expref: 22 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.429430:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2ce00, rc 0) 00000100:00100000:3.0:1790919499.429473:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f392316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978194944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 306us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919499.429485:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790919499.431196:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978194944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919499.431226:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.431238:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919499.431986:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.432042:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919499.432171:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b62723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919499.434729:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195072 00000100:00100000:0.0:1790919499.434744:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195072 00000100:00100000:0.0:1790919499.434914:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1790919499.434924:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978195072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.435558:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978195072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 634us (3514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.435566:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1790919499.435647:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.435704:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.435745:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919499.435777:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919499.435924:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195200 00000100:00100000:0.0:1790919499.435989:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195200 00000100:00100000:0.0:1790919499.436072:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1790919499.436080:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978195200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.436243:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978195200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.436260:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1790919499.436528:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.436691:0:13300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13300:1877914978195328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919499.436738:0:13300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919499.436756:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195328 00000100:00100000:2.0:1790919499.436760:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195328 00000100:00100000:2.0:1790919499.436778:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1790919499.436784:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:13300:x1877914978195328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919499.436936:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:13300:x1877914978195328:12345-0@lo:502:llog_process_th.0 Request processed in 141us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.436944:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1790919499.436978:0:13300:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.436989:0:13300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13300:1877914978195328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919499.437009:0:13300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919499.437018:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919499.437020:0:13300:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919499.437032:0:13300:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3be491000 00000020:00000080:2.0:1790919499.437034:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919499.437110:0:13300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919499.437568:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919499.437571:0:13300:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919499.437576:0:13300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919499.437579:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919499.437581:0:13300:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790919499.437585:0:13300:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3be491000 00000020:00000080:2.0:1790919499.437587:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790919499.437784:0:13300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13300:1877914978195456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919499.437837:0:13300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919499.437860:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195456 00000100:00100000:2.0:1790919499.437864:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195456 00000100:00100000:2.0:1790919499.437886:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1790919499.437892:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:13300:x1877914978195456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919499.438030:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:13300:x1877914978195456:12345-0@lo:502:llog_process_th.0 Request processed in 138us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.438037:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1790919499.438095:0:13300:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.438109:0:13300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13300:1877914978195456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919499.438128:0:13300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919499.438132:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919499.438133:0:13300:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790919499.438137:0:13300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1790919499.438184:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1790919499.438213:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919499.438221:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.438241:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919499.438934:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919499.438938:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4712800 from 7 10000000:01000000:2.0:1790919499.438942:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919499.438969:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.438979:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.438990:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919499.439007:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.439043:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919499.439330:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.439361:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195584 00000100:00100000:2.0:1790919499.439366:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195584 00000100:00100000:2.0:1790919499.439390:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1790919499.439398:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:6443:x1877914978195584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919499.439410:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919499.439421:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3c204a000/0x951c50ad159138c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159138c1 expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.439442:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3c204a000/0x951c50ad159138c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159138c1 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.439466:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3c204a000/0x951c50ad159138c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159138c1 expref: 23 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.439474:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204a000, rc 0) 00000100:00100000:2.0:1790919499.439507:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978195584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.439514:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1790919499.439549:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919499.439562:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919499.439570:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919499.439625:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.439649:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919499.439661:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.439672:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195712 00000100:00100000:2.0:1790919499.439676:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195712 00000100:00100000:2.0:1790919499.439703:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1790919499.439710:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978195712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.440476:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978195712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 764us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.440484:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1790919499.440747:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.440783:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.440823:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.440858:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6480 going to sleep for 11 seconds 00000100:00100000:0.0:1790919499.442364:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195840 00000100:00100000:0.0:1790919499.442377:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195840 00000100:00100000:0.0:1790919499.442425:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1790919499.442433:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978195840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.442644:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978195840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.442652:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1790919499.443512:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978195840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.443992:0:13301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13301:1877914978195968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919499.444356:0:13301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919499.444425:0:13301:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.444456:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978195968 00000100:00100000:2.0:1790919499.444462:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978195968 00000100:00100000:2.0:1790919499.444526:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790919499.444534:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:13301:x1877914978195968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919499.444738:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:13301:x1877914978195968:12345-0@lo:502:llog_process_th.0 Request processed in 204us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.444745:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1790919499.444814:0:13301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13301:1877914978195968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919499.444840:0:13301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919499.444849:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.444851:0:13301:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919499.444859:0:13301:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3b4712800 00000020:00000080:3.0:1790919499.444861:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919499.444915:0:13301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919499.444919:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.444920:0:13301:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919499.444923:0:13301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919499.444926:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.444927:0:13301:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790919499.444930:0:13301:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3b4712800 00000020:00000080:3.0:1790919499.444932:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790919499.444965:0:13301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13301:1877914978196096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919499.445001:0:13301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919499.445253:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196096 00000100:00100000:0.0:1790919499.445264:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196096 00000100:00100000:0.0:1790919499.445283:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1790919499.445290:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:13301:x1877914978196096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919499.445403:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:13301:x1877914978196096:12345-0@lo:502:llog_process_th.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.445410:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1790919499.445890:0:13301:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919499.445907:0:13301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13301:1877914978196096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790919499.445928:0:13301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919499.445933:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919499.445935:0:13301:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790919499.445939:0:13301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:2.0:1790919499.447429:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1790919499.447662:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790919499.447685:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919499.447706:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.447717:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919499.447773:0:6443:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919499.447776:0:6443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385571800 from 7 10000000:01000000:3.0:1790919499.447779:0:6443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919499.448024:0:6443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.448033:0:6443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.448042:0:6443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919499.448083:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978196224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.448282:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.448347:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919499.448384:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196224 00000100:00100000:1.0:1790919499.448391:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196224 00000100:00100000:1.0:1790919499.448429:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1790919499.448439:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:6443:x1877914978196224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919499.448452:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919499.448463:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1c000/0x951c50ad159138d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159138cf expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.448534:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1c000/0x951c50ad159138d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159138cf expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.448545:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1c000/0x951c50ad159138d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159138cf expref: 24 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.448554:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c000, rc 0) 00000100:00100000:1.0:1790919499.448627:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978196224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.448634:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790919499.448707:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978196224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919499.448721:0:6443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919499.448730:0:6443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919499.448775:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978196352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.448919:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.449002:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919499.449090:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196352 00000100:00100000:0.0:1790919499.449095:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196352 00000100:00100000:0.0:1790919499.449129:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1790919499.449136:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978196352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.449355:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3927fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978196352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.449362:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1790919499.449378:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978196352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.449406:0:6443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978196480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919499.449448:0:6443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.449515:0:6443:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919499.449681:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196480 00000100:00100000:1.0:1790919499.449690:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196480 00000100:00100000:1.0:1790919499.449754:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1790919499.449761:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978196480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.449899:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:6443:x1877914978196480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.449906:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1790919499.449943:0:6443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1948390b-ad58-4044-9ddd-8f90f3aaa52f:6443:1877914978196480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.450636:0:13303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13303:1877914978196608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919499.450677:0:13303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919499.450747:0:13303:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919499.450778:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196608 00000100:00100000:1.0:1790919499.450782:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196608 00000100:00100000:1.0:1790919499.450833:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1790919499.450841:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:13303:x1877914978196608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919499.451116:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:13303:x1877914978196608:12345-0@lo:502:llog_process_th.0 Request processed in 275us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.451124:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790919499.451217:0:13303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13303:1877914978196608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919499.451256:0:13303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919499.451264:0:13303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.451266:0:13303:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919499.451273:0:13303:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f385571800 00000020:00000080:3.0:1790919499.451276:0:13303:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919499.451362:0:13303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919499.451366:0:13303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.451367:0:13303:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919499.451370:0:13303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919499.451372:0:13303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.451374:0:13303:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790919499.451377:0:13303:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f385571800 00000020:00000080:3.0:1790919499.451379:0:13303:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790919499.451750:0:13303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13303:1877914978196736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919499.451788:0:13303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919499.451815:0:13303:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919499.451861:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196736 00000100:00100000:1.0:1790919499.451866:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196736 00000100:00100000:1.0:1790919499.451908:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1790919499.451915:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:13303:x1877914978196736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919499.452089:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:13303:x1877914978196736:12345-0@lo:502:llog_process_th.0 Request processed in 174us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.452096:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790919499.452333:0:13303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1948390b-ad58-4044-9ddd-8f90f3aaa52f:13303:1877914978196736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919499.452354:0:13303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919499.452358:0:13303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919499.452359:0:13303:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790919499.452363:0:13303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790919499.452569:0:6443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790919499.452591:0:6443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919499.452600:0:6443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.452620:0:6443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919499.459710:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919499.528019:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919499.528098:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958193920 00000100:00100000:1.0:1790919499.528107:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958193920 00000100:00100000:1.0:1790919499.528158:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 350 00000100:00100000:1.0:1790919499.528169:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+11:6386:x1877914958193920:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919499.528186:0:6439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919499.528202:0:6439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1dc00/0x951c50ad159138dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38be5 expref: -99 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.528547:0:6439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1dc00/0x951c50ad159138dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38be5 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.528565:0:6439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1dc00/0x951c50ad159138dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38be5 expref: 12 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.528575:0:6439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1dc00, rc 0) 00000100:00100000:1.0:1790919499.528646:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958193920:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 478us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.528654:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 350 00000100:00100000:3.0:1790919499.534238:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919499.539890:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194048 00000100:00100000:1.0:1790919499.539906:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194048 00000100:00100000:1.0:1790919499.539964:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 351 00000100:00100000:1.0:1790919499.539974:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958194048:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.540274:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958194048:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 300us (6229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.540287:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 351 00000100:00100000:1.0:1790919499.544666:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919499.544913:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194176 00000100:00100000:0.0:1790919499.544923:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194176 00000100:00100000:0.0:1790919499.545007:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 352 00000100:00100000:0.0:1790919499.545017:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958194176:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919499.545312:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958194176:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 295us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.545319:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 352 00000100:00100000:0.0:1790919499.549878:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919499.550097:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194304 00000100:00100000:1.0:1790919499.550107:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194304 00000100:00100000:0.0:1790919499.550232:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 353 00000100:00100000:0.0:1790919499.550250:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+12:10903:x1877914958194304:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919499.550497:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+12:10903:x1877914958194304:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 246us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.550506:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 353 00000100:00100000:2.0:1790919499.559260:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919499.559358:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194432 00000100:00100000:0.0:1790919499.559367:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194432 00000100:00100000:0.0:1790919499.559423:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 354 00000100:00100000:0.0:1790919499.559433:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:10903:x1877914958194432:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919499.559677:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+12:10903:x1877914958194432:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 245us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.559686:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 354 00000100:00100000:2.0:1790919499.565805:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919499.565970:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194560 00000100:00100000:1.0:1790919499.565981:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194560 00000100:00100000:1.0:1790919499.566038:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 355 00000100:00100000:1.0:1790919499.566049:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+12:6386:x1877914958194560:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919499.566086:0:6440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919499.566104:0:6440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1d400/0x951c50ad159138e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bec expref: -99 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.566133:0:6440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d400/0x951c50ad159138e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bec expref: 13 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.566145:0:6440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1d400/0x951c50ad159138e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bec expref: 13 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919499.566154:0:6440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d400, rc 0) 00000100:00100000:1.0:1790919499.566217:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958194560:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 169us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.566226:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 355 00000100:00100000:1.0:1790919499.575190:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919499.575247:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194688 00000100:00100000:2.0:1790919499.575262:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194688 00000100:00100000:2.0:1790919499.575319:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 356 00000100:00100000:2.0:1790919499.575329:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958194688:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919499.575611:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958194688:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 281us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919499.575620:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 356 00000100:00100000:2.0:1790919499.579533:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919499.579605:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194816 00000100:00100000:1.0:1790919499.579616:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194816 00000100:00100000:1.0:1790919499.579677:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 357 00000100:00100000:1.0:1790919499.579688:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958194816:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919499.579951:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:6386:x1877914958194816:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 264us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919499.579959:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 357 00000100:00100000:2.0:1790919499.585409:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919499.585689:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958194944 00000100:00100000:0.0:1790919499.585709:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958194944 00000100:00100000:0.0:1790919499.585758:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 358 00000100:00100000:0.0:1790919499.585767:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:10907:x1877914958194944:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919499.586086:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:10907:x1877914958194944:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 319us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.586095:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 358 00000100:00100000:0.0:1790919499.593865:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919499.594647:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195072 00000100:00100000:1.0:1790919499.594659:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195072 00000100:00100000:0.0:1790919499.595357:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 359 00000100:00100000:0.0:1790919499.595370:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:10907:x1877914958195072:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919499.595621:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:10907:x1877914958195072:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 253us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919499.595631:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 359 00010000:00010000:0.0:1790919500.188224:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919500.508736:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790919500.509471:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790919500.701345:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978196864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919500.701414:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919500.701459:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196864 00000100:00100000:3.0:1790919500.701468:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196864 00000100:00100000:3.0:1790919500.701527:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919500.701537:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978196864:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919500.701576:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978196992:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919500.701582:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919500.701603:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919500.701623:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978196864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919500.701631:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919500.701645:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978196992 00000100:00100000:3.0:1790919500.701648:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978196992 00000100:00100000:3.0:1790919500.701669:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790919500.701674:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978196992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919500.701693:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1790919500.701700:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b58bd180 x1877914978196864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919500.701717:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978196864:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790919500.701793:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919500.701975:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978196992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919500.701982:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1790919500.702035:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc235c00 x1877914978196992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919500.702048:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978196992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919500.702121:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978197120:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702158:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919500.702187:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978197632:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.702187:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978197376:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702213:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919500.702221:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919500.702230:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978198144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.702241:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978197888:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702252:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919500.702258:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919500.702270:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790919500.702270:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978198400:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702274:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978197504:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.702289:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919500.702291:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919500.702304:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978198016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.702305:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790919500.702309:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978197248:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702323:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919500.702326:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919500.702338:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978197760:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702348:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197632 00000100:00100000:2.0:1790919500.702352:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197632 00000100:00100000:0.0:1790919500.702357:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919500.702371:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978198272:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702372:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197888 00000100:00100000:2.0:1790919500.702387:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197888 00000100:00100000:0.0:1790919500.702391:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919500.702407:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198400 00000100:00100000:0.0:1790919500.702409:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197248 00000100:00100000:2.0:1790919500.702410:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198400 00000100:00100000:0.0:1790919500.702411:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197248 00000100:00100000:2.0:1790919500.702421:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197760 00000100:00100000:2.0:1790919500.702428:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197760 00000100:00100000:0.0:1790919500.702433:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198272 00000100:00100000:0.0:1790919500.702435:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198272 00000100:00100000:2.0:1790919500.702442:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790919500.702448:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978197632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.702449:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790919500.702453:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702485:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978197632:12345-0@lo:400:kworker.0 Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919500.702485:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978197888:12345-0@lo:400:kworker.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919500.702491:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790919500.702604:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790919500.702621:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790919500.702627:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978198400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702664:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978198400:12345-0@lo:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919500.702670:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790919500.702682:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790919500.702699:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978197248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702798:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978197248:12345-0@lo:400:kworker.0 Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919500.702898:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790919500.702914:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790919500.702921:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978197760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702951:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978197760:12345-0@lo:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919500.702957:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790919500.702967:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790919500.702972:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.702996:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978198272:12345-0@lo:400:kworker.0 Request processed in 24us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919500.703001:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790919500.703018:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198144 00000100:00100000:2.0:1790919500.703022:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198144 00000100:00100000:2.0:1790919500.703045:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198016 00000100:00100000:2.0:1790919500.703047:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198016 00000100:00100000:2.0:1790919500.703087:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919500.703093:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978198144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919500.703269:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197376 00000100:00100000:3.0:1790919500.703274:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197376 00000100:00100000:3.0:1790919500.703297:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197504 00000100:00100000:3.0:1790919500.703300:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197504 00000100:00100000:3.0:1790919500.703312:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790919500.703317:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978197376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919500.703351:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978197376:12345-0@lo:400:kworker.0 Request processed in 34us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919500.703356:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790919500.703367:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790919500.703372:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978197504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919500.703568:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978197504:12345-0@lo:400:kworker.0 Request processed in 195us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919500.703575:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790919500.703625:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790919500.703634:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978198016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919500.703666:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978198016:12345-0@lo:400:kworker.0 Request processed in 34us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919500.703672:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1790919500.703701:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919500.703706:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919500.703709:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919500.703804:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978198144:12345-0@lo:400:kworker.0 Request processed in 711us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919500.704344:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919500.704396:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b58bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978197504:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.704407:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978198016:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.704417:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978197632:0@lo:400:kworker.0 00000100:00100000:2.0:1790919500.704428:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978198144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.704856:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978197248:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.704869:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978197760:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.704880:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978198272:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.704889:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978197376:0@lo:400:kworker.0 00010000:00080000:0.0:1790919500.704902:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac1180 x1877914978197888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919500.704911:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978197888:0@lo:400:kworker.0 00010000:00080000:0.0:1790919500.704923:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f391516300 x1877914978198400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919500.704929:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978198400:0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.704994:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978197120 00000100:00100000:0.0:1790919500.705000:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978197120 00000100:00100000:0.0:1790919500.705037:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1790919500.705044:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978197120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919500.705126:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978197120:12345-0@lo:400:kworker.0 Request processed in 81us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919500.705144:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1790919500.707860:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978197120:0@lo:400:kworker.0 00010000:00010000:1.0:1790919501.212335:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919502.236292:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919503.260355:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919503.772689:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978198528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919503.772761:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919503.773000:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198528 00000100:00100000:1.0:1790919503.773009:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198528 00000100:00100000:1.0:1790919503.773067:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790919503.773076:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978198528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919503.773114:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919503.773159:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978198528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919503.773166:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790919503.773216:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978198528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919503.773769:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978198656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919503.773809:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919503.773858:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198656 00000100:00100000:0.0:1790919503.773863:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198656 00000100:00100000:0.0:1790919503.773894:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790919503.773902:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978198656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919503.773926:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919503.773965:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978198656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919503.773972:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790919503.774141:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978198656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919503.828319:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919503.828360:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919503.828380:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919503.828403:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919503.828422:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919503.828440:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919503.828463:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195200 00000100:00100000:0.0:1790919503.828473:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195200 00000100:00100000:0.0:1790919503.828518:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 361 00000100:00100000:0.0:1790919503.828528:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958195200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919503.828591:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958195200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919503.828599:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 361 00000100:00100000:0.0:1790919503.828630:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195328 00000100:00100000:0.0:1790919503.828644:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195328 00000100:00100000:0.0:1790919503.828686:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195840 00000100:00100000:0.0:1790919503.828689:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195840 00000100:00100000:0.0:1790919503.828701:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195456 00000100:00100000:0.0:1790919503.828703:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195456 00000100:00100000:0.0:1790919503.828713:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195712 00000100:00100000:0.0:1790919503.828715:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195712 00000100:00100000:0.0:1790919503.828728:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:0.0:1790919503.828734:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958195328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919503.828765:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958195328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919503.828772:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:0.0:1790919503.828784:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:0.0:1790919503.828790:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958195840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919503.828811:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958195840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919503.828816:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:0.0:1790919503.828828:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:0.0:1790919503.828833:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958195456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919503.828849:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958195456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 17us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919503.828854:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:0.0:1790919503.828862:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1790919503.828867:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958195712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919503.828883:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958195712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 16us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919503.828894:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:3.0:1790919503.837791:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195584 00000100:00100000:3.0:1790919503.837806:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195584 00000100:00100000:3.0:1790919503.837870:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1790919503.837933:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958195584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919503.838021:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958195584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 142us (9659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919503.838029:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00080000:3.0:1790919503.838335:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919503.838340:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919503.838343:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1790919503.853072:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1790919504.284363:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919504.284386:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978198784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919504.284460:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919504.284532:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198784 00000100:00100000:0.0:1790919504.284539:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198784 00000100:00100000:0.0:1790919504.284594:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790919504.284604:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978198784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919504.284644:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790919504.284675:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919504.284900:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978198784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 297us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919504.284908:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919504.284985:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978198784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790919504.285188:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919504.285352:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919504.285363:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978198912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919504.285399:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919504.285567:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978198912 00000100:00100000:3.0:1790919504.285573:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978198912 00000100:00100000:3.0:1790919504.285617:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790919504.285625:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978198912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919504.285638:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919504.285695:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978198912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919504.285712:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790919504.285825:0:3458:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1790919504.285831:0:3458:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f3b58bc700, transno 4294967301 00000100:00100000:1.0:1790919504.285852:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978198912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790919504.285994:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919505.308554:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919505.821030:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919505.821069:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978199040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919505.821136:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919505.821202:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199040 00000100:00100000:0.0:1790919505.821209:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199040 00000100:00100000:0.0:1790919505.821254:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790919505.821264:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978199040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919505.821297:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919505.821339:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978199040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919505.821346:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1790919505.821382:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac2a00 x1877914978199040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919505.821399:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978199040:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790919505.821482:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919505.821621:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919505.821631:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978199168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919505.821671:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.821743:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199168 00000100:00100000:1.0:1790919505.821748:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199168 00000100:00100000:1.0:1790919505.821785:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790919505.821792:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978199168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919505.821802:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919505.821833:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978199168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.821838:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1790919505.821887:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790919505.821907:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843eb800 x1877914978199168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919505.821919:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978199168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919505.828098:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978199296:0@lo:400:kworker.0 00000100:00100000:2.0:1790919505.828182:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919505.828476:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199296 00000100:00100000:0.0:1790919505.828485:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199296 00000100:00100000:0.0:1790919505.828529:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1790919505.828538:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978199296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.830444:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978199424:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.830499:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.830546:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199424 00000100:00100000:1.0:1790919505.830551:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199424 00000100:00100000:1.0:1790919505.830586:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790919505.830592:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978199424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.830633:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978199424:12345-0@lo:400:kworker.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.830639:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790919505.830686:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978199424:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831552:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978199552:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831592:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.831625:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978200064:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831671:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.831688:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978200576:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831709:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.831731:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919505.831737:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978199680:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831758:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.831776:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978200192:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831801:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.831829:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200064 00000100:00100000:1.0:1790919505.831834:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200064 00000100:00100000:1.0:1790919505.831865:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200576 00000100:00100000:1.0:1790919505.831867:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200576 00000100:00100000:1.0:1790919505.831879:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790919505.831884:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978200064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831914:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978200064:12345-0@lo:400:kworker.0 Request processed in 30us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.831918:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790919505.831929:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790919505.831933:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978200576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.831949:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978200576:12345-0@lo:400:kworker.0 Request processed in 15us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.831954:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790919505.831973:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199552 00000100:00100000:1.0:1790919505.831977:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199552 00000100:00100000:1.0:1790919505.831995:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199680 00000100:00100000:1.0:1790919505.831998:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199680 00000100:00100000:1.0:1790919505.832010:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790919505.832022:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978199552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832078:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978199552:12345-0@lo:400:kworker.0 Request processed in 56us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832084:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790919505.832100:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790919505.832106:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978199680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832133:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978199680:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832139:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790919505.832159:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978199936:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832199:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.832216:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978200448:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832234:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.832248:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790919505.832254:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978199808:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832273:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.832288:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978200320:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832308:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919505.832332:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199936 00000100:00100000:1.0:1790919505.832335:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199936 00000100:00100000:1.0:1790919505.832355:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200448 00000100:00100000:1.0:1790919505.832357:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200448 00000100:00100000:1.0:1790919505.832367:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978199808 00000100:00100000:1.0:1790919505.832370:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978199808 00000100:00100000:1.0:1790919505.832381:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790919505.832387:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978199936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832429:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978199936:12345-0@lo:400:kworker.0 Request processed in 43us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832435:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790919505.832446:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790919505.832452:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978200448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832477:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978200448:12345-0@lo:400:kworker.0 Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832482:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790919505.832492:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790919505.832497:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978199808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832523:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978199808:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832528:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790919505.832573:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978199680:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832583:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978199552:0@lo:400:kworker.0 00010000:00080000:1.0:1790919505.832599:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658f480 x1877914978200064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919505.832609:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978200064:0@lo:400:kworker.0 00010000:00080000:1.0:1790919505.832620:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b59a7100 x1877914978200576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919505.832627:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978200576:0@lo:400:kworker.0 00000100:00100000:2.0:1790919505.832667:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200192 00000100:00100000:1.0:1790919505.832668:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978199808:0@lo:400:kworker.0 00000100:00100000:2.0:1790919505.832671:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200192 00000100:00100000:1.0:1790919505.832676:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978199936:0@lo:400:kworker.0 00000100:00100000:1.0:1790919505.832693:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978200448:0@lo:400:kworker.0 00000100:00100000:2.0:1790919505.832698:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200320 00000100:00100000:2.0:1790919505.832705:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200320 00000100:00100000:2.0:1790919505.832730:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919505.832738:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978200192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919505.832750:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978199296:12345-0@lo:400:kworker.0 Request processed in 4210us (4564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832752:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790919505.832764:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978200320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919505.832765:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1790919505.832779:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978200192:12345-0@lo:400:kworker.0 Request processed in 41us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919505.832785:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790919505.832802:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978200320:12345-0@lo:400:kworker.0 Request processed in 41us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919505.832808:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1790919505.832814:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919505.832819:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919505.832835:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978200320:0@lo:400:kworker.0 00000100:00100000:0.0:1790919505.832875:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978200192:0@lo:400:kworker.0 00000100:00100000:2.0:1790919505.833009:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978199296:0@lo:400:kworker.0 00010000:00010000:2.0:1790919506.332317:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919507.356326:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919508.380802:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919508.892283:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919508.892305:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978200704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919508.892372:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919508.892438:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200704 00000100:00100000:2.0:1790919508.892446:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200704 00000100:00100000:2.0:1790919508.892493:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790919508.892503:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978200704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919508.892541:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919508.892589:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978200704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919508.892597:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790919508.892660:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978200704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919508.906762:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919508.906783:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978200832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919508.906852:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919508.907116:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200832 00000100:00100000:3.0:1790919508.907126:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200832 00000100:00100000:3.0:1790919508.907174:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790919508.907183:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978200832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919508.907223:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919508.907276:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978200832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919508.907283:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790919508.907328:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978200832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919508.939394:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919508.939428:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919508.939448:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919508.939472:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919508.939494:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919508.939518:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919508.939544:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958195968 00000100:00100000:3.0:1790919508.939554:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958195968 00000100:00100000:3.0:1790919508.939600:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 363 00000100:00100000:3.0:1790919508.939610:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958195968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919508.940189:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958195968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 578us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919508.940198:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 363 00000100:00100000:3.0:1790919508.940350:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196352 00000100:00100000:3.0:1790919508.940355:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196352 00000100:00100000:3.0:1790919508.940392:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790919508.940476:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958196352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919508.940515:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958196352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919508.940522:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790919508.940541:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196096 00000100:00100000:3.0:1790919508.940545:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196096 00000100:00100000:3.0:1790919508.940570:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196608 00000100:00100000:3.0:1790919508.940573:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196608 00000100:00100000:3.0:1790919508.940585:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196224 00000100:00100000:3.0:1790919508.940587:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196224 00000100:00100000:3.0:1790919508.940600:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196480 00000100:00100000:3.0:1790919508.940603:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196480 00000100:00100000:3.0:1790919508.940617:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:3.0:1790919508.940635:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958196096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919508.940666:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958196096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919508.940673:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:0.0:1790919508.941729:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:0.0:1790919508.941740:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958196608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919508.942449:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:0.0:1790919508.942458:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958196224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919508.942495:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958196224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919508.942503:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:0.0:1790919508.942522:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1790919508.942529:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958196480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919508.942552:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958196480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919508.942567:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1790919508.942593:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958196608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 856us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919508.942600:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00080000:3.0:1790919508.943777:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919508.943785:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919508.943788:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919509.404667:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978200960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919509.404737:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919509.404844:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919509.404908:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978200960 00000100:00100000:3.0:1790919509.404921:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978200960 00000100:00100000:1.0:1790919509.404965:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919509.404975:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978201088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919509.404980:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790919509.404989:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978200960:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919509.405002:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919509.405032:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201088 00002000:00000024:3.0:1790919509.405036:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919509.405036:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201088 00000100:00100000:3.0:1790919509.405099:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978200960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919509.405103:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790919509.405107:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790919509.405110:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978201088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919509.405119:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919509.405148:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978201088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919509.405153:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790919509.405160:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978200960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919509.405184:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978201088:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790919509.405285:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919510.429484:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919510.750094:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790919510.759445:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790919510.940573:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919510.940603:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978201216:0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.940709:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919510.940753:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978201472:0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.940774:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978201600:0@lo:400:kworker.0 00000100:00100000:1.0:1790919510.940977:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978201344:0@lo:400:kworker.0 00000100:00100000:0.0:1790919510.942199:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201216 00000100:00100000:0.0:1790919510.942215:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201216 00000100:00100000:0.0:1790919510.942534:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1790919510.942547:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978201216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.944298:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919510.944461:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201472 00000100:00100000:2.0:1790919510.944491:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201472 00000100:00100000:3.0:1790919510.944503:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978201984:0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.944573:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790919510.944581:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919510.944593:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978201472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.944655:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978202496:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.944697:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919510.944714:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978201472:12345-0@lo:400:kworker.0 Request processed in 129us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919510.944724:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790919510.944747:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201984 00000100:00100000:3.0:1790919510.944755:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201984 00000100:00100000:2.0:1790919510.944778:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919510.944821:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202496 00000100:00100000:3.0:1790919510.944826:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202496 00000100:00100000:3.0:1790919510.944852:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790919510.944860:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978201984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.945146:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978201984:12345-0@lo:400:kworker.0 Request processed in 284us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.945154:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790919510.945176:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790919510.945183:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978202496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.945214:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978202496:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.945220:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790919510.945236:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978202112:0@lo:400:kworker.0 00000100:00080000:3.0:1790919510.945242:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790919510.945289:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac1180 x1877914978202496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919510.945306:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978202496:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.949642:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978201472:0@lo:400:kworker.0 00010000:00080000:3.0:1790919510.949673:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b59a7800 x1877914978201984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919510.949686:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978201984:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.949874:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201600 00000100:00100000:3.0:1790919510.949883:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201600 00000100:00100000:2.0:1790919510.949902:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919510.949952:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790919510.949961:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978202624:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.949972:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978201600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.950006:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919510.950045:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790919510.950083:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978201728:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.950105:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978201600:12345-0@lo:400:kworker.0 Request processed in 140us (5325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.950114:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790919510.950123:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919510.950163:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202112 00000100:00100000:2.0:1790919510.950163:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978202240:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.950169:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202112 00000100:00100000:3.0:1790919510.950201:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202624 00000100:00100000:3.0:1790919510.950204:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202624 00000100:00100000:3.0:1790919510.950230:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790919510.950236:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978202112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.950278:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978202112:12345-0@lo:400:kworker.0 Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.950284:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790919510.950294:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790919510.950299:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978202624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.950328:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978202624:12345-0@lo:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.950333:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1790919510.950376:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919510.950478:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978203008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919510.950515:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919510.950542:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203008 00000100:00100000:3.0:1790919510.950546:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203008 00000100:00100000:3.0:1790919510.950577:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790919510.950588:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978203008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919510.950632:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919510.950664:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978203008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.950670:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1790919510.950682:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790919510.950702:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac1180 x1877914978203008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919510.950719:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978203008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919510.950751:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201728 00000100:00100000:3.0:1790919510.950754:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201728 00000100:00100000:3.0:1790919510.950778:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790919510.950783:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978201728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.950813:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978201728:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.950819:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790919510.950981:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919510.951022:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978202752:0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.951091:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919510.951139:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978201600:0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.951159:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978202112:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.951408:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202240 00000100:00100000:3.0:1790919510.951415:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202240 00000100:00100000:3.0:1790919510.951439:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202752 00000100:00100000:3.0:1790919510.951443:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202752 00000100:00100000:3.0:1790919510.951511:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790919510.951519:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978202240:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790919510.951592:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac0700 x1877914978202624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919510.951606:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978202624:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.951628:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978202240:12345-0@lo:400:kworker.0 Request processed in 107us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.951640:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790919510.951663:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790919510.951670:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978201728:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.951673:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978202752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.951715:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978202240:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.951727:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978202752:12345-0@lo:400:kworker.0 Request processed in 52us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.951739:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1790919510.951740:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac0a80 x1877914978202752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919510.952286:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978202752:0@lo:400:kworker.0 00000100:00100000:1.0:1790919510.953348:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919510.953414:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978201856:0@lo:400:kworker.0 00000100:00100000:1.0:1790919510.953462:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919510.953508:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201344 00000100:00100000:1.0:1790919510.953517:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201344 00000100:00100000:2.0:1790919510.953558:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978201856 00000100:00100000:2.0:1790919510.953564:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978201856 00000100:00100000:1.0:1790919510.953573:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790919510.953584:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978201344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.953622:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1790919510.953634:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978201856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919510.953643:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978201216:0@lo:400:kworker.0 00000100:00100000:3.0:1790919510.953644:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978201216:12345-0@lo:400:kworker.0 Request processed in 11093us (12933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.953661:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1790919510.953666:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978201344:12345-0@lo:400:kworker.0 Request processed in 76us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919510.953682:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1790919510.953704:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978201856:12345-0@lo:400:kworker.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919510.953716:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1790919510.953730:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978201856:0@lo:400:kworker.0 00000100:00100000:0.0:1790919510.953748:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978202368:0@lo:400:kworker.0 00000100:00080000:3.0:1790919510.953765:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919510.959727:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919510.959792:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978202880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919510.959829:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919510.959905:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978201344:0@lo:400:kworker.0 00000100:00100000:2.0:1790919510.959932:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202880 00000100:00100000:2.0:1790919510.959940:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202880 00000100:00100000:2.0:1790919510.960003:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790919510.960013:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978202880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919510.960037:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919510.960108:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978202880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919510.960116:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1790919510.963312:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843ebb80 x1877914978202880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919510.963341:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978202880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919510.964358:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978202368 00000100:00100000:3.0:1790919510.964369:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978202368 00000100:00100000:3.0:1790919510.964452:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790919510.964462:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978202368:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790919510.964466:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919510.964563:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978202368:12345-0@lo:400:kworker.0 Request processed in 103us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919510.964571:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790919510.965150:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978202368:0@lo:400:kworker.0 00010000:00010000:1.0:1790919511.452776:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919512.477208:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919513.500333:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919514.012689:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919514.012712:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978203136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919514.012782:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919514.012889:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203136 00000100:00100000:1.0:1790919514.012898:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203136 00000100:00100000:1.0:1790919514.012958:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790919514.012967:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978203136:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919514.013110:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978203264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919514.013141:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919514.013182:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203264 00000100:00100000:0.0:1790919514.013186:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203264 00000100:00100000:0.0:1790919514.013207:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919514.013214:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978203264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919514.013258:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919514.013315:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978203264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919514.013335:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000004:00000024:1.0:1790919514.013494:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919514.013537:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978203136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 572us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919514.013545:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790919514.013659:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978203264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919514.013675:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978203136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919514.062242:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919514.062518:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919514.062581:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919514.062690:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196992 00000100:00100000:2.0:1790919514.062701:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196992 00000100:00100000:2.0:1790919514.062763:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196864 00000100:00100000:2.0:1790919514.062767:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196864 00000100:00100000:2.0:1790919514.062789:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:2.0:1790919514.062809:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958196992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919514.062829:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:0.0:1790919514.062842:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958196864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919514.062887:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958196992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 79us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919514.062888:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958196864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919514.062903:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:0.0:1790919514.062929:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00080000:3.0:1790919514.063377:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919514.063382:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919514.064137:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958196736 00000100:00100000:1.0:1790919514.064147:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958196736 00000100:00100000:1.0:1790919514.064231:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 365 00000100:00100000:1.0:1790919514.064240:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958196736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919514.064501:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958196736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 261us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919514.064510:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 365 00000100:00100000:3.0:1790919514.068102:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919514.068136:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919514.068187:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197376 00000100:00100000:1.0:1790919514.068197:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197376 00000100:00100000:3.0:1790919514.068211:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00080000:3.0:1790919514.068242:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919514.068258:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197248 00000100:00100000:1.0:1790919514.068262:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197248 00000100:00100000:1.0:1790919514.068299:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:1.0:1790919514.068308:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958197376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919514.068391:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958197376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919514.068399:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:1.0:1790919514.068418:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:1.0:1790919514.068425:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958197248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919514.068538:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197120 00000100:00100000:0.0:1790919514.068544:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197120 00000100:00080000:3.0:1790919514.068562:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919514.068567:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919514.068584:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958197248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 157us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919514.068604:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:0.0:1790919514.068643:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790919514.068654:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2410:x1877914958197120:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1790919514.068674:0:8248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591380b 00000100:00080000:0.0:1790919514.068682:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919514.068727:0:8248:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1790919514.068983:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+2:2410:x1877914958197120:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 331us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919514.068990:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00010000:00010000:3.0:1790919514.069913:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919514.524340:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978203392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919514.524420:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919514.524661:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919514.527434:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203392 00000100:00100000:1.0:1790919514.527447:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203392 00000100:00100000:1.0:1790919514.527521:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919514.527533:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978203392:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919514.527546:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790919514.527571:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919514.527680:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978203392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (3259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919514.527687:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790919514.527907:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978203392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919514.529456:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978203520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919514.529517:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919514.529729:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203520 00000100:00100000:0.0:1790919514.529736:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203520 00000100:00100000:0.0:1790919514.529796:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790919514.529805:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978203520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919514.529824:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790919514.529922:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919514.529962:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978203520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919514.529970:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790919514.533843:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978203520:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790919515.548809:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919516.061462:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978204032:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061526:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.061559:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204032 00000100:00100000:1.0:1790919516.061565:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204032 00000100:00100000:1.0:1790919516.061623:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790919516.061631:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978204032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061683:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978204032:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.061690:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790919516.061754:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978204032:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061761:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978204544:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061785:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.061809:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204544 00000100:00100000:1.0:1790919516.061812:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204544 00000100:00100000:1.0:1790919516.061843:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790919516.061850:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978204544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061881:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978204544:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.061887:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1790919516.061903:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919516.061928:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978204544:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061935:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205056:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.061975:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.061997:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205056 00000100:00100000:1.0:1790919516.062001:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205056 00000100:00100000:1.0:1790919516.062029:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790919516.062035:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062088:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205056:12345-0@lo:400:kworker.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.062094:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1790919516.062107:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790919516.062130:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a01180 x1877914978205056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919516.062141:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205056:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062162:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790919516.062167:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978203904:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062525:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.062549:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203904 00000100:00100000:1.0:1790919516.062553:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203904 00000100:00100000:1.0:1790919516.062587:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790919516.062594:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978203904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062626:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978203904:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.062747:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790919516.062784:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978203904:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062791:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978204416:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062818:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.062853:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204416 00000100:00100000:1.0:1790919516.062858:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204416 00000100:00100000:1.0:1790919516.062890:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790919516.062896:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978204416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062928:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978204416:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.062933:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:1.0:1790919516.062949:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790919516.062968:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a02300 x1877914978204416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919516.062979:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978204416:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.062985:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978204928:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.063006:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.063315:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204928 00000100:00100000:1.0:1790919516.063319:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204928 00000100:00100000:1.0:1790919516.063356:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1790919516.063364:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.063470:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978204928:12345-0@lo:400:kworker.0 Request processed in 107us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.063477:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790919516.063491:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978203776:0@lo:400:kworker.0 00000100:00080000:1.0:1790919516.063499:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919516.063511:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978203648:0@lo:400:kworker.0 00000100:00100000:2.0:1790919516.063532:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.063549:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919516.063563:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978204288:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.063590:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978204160:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.063619:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919516.063645:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203648 00000100:00100000:2.0:1790919516.063650:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203648 00000100:00100000:2.0:1790919516.063683:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1790919516.063690:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978203648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919516.065310:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978203776 00000100:00100000:0.0:1790919516.065327:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978203776 00000100:00100000:0.0:1790919516.065362:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204160 00000100:00100000:0.0:1790919516.065365:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204160 00000100:00100000:0.0:1790919516.065387:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1790919516.065394:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978203776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919516.065536:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790919516.065545:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978204160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919516.068677:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978203648:12345-0@lo:400:kworker.0 Request processed in 4977us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919516.068692:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00080000:2.0:1790919516.068794:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a03480 x1877914978204928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919516.068809:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978204928:0@lo:400:kworker.0 00000100:00100000:2.0:1790919516.068833:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919516.068845:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919516.068881:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.069408:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978204672:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.069449:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.069471:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978205184:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.069493:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.069521:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978203648:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.069534:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919516.069539:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978205312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919516.069560:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.069606:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204672 00000100:00100000:1.0:1790919516.069612:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204672 00000100:00100000:2.0:1790919516.069631:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205440 00000100:00100000:2.0:1790919516.069637:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205440 00000100:00100000:1.0:1790919516.069670:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205184 00000100:00100000:2.0:1790919516.069673:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205312 00000100:00100000:1.0:1790919516.069674:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205184 00000100:00100000:2.0:1790919516.069678:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205312 00000100:00100000:2.0:1790919516.069702:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790919516.069709:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790919516.069714:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205440:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919516.069722:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978204672:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1790919516.069752:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919516.069773:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978204672:12345-0@lo:400:kworker.0 Request processed in 53us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.069780:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790919516.069797:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790919516.069802:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.069808:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978205184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919516.069815:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790919516.069832:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790919516.069841:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978205312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919516.069846:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978205184:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.069852:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00002000:00000024:2.0:1790919516.069855:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919516.069887:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978205312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (326us total) trans 0 rc 0/0 00000100:00080000:1.0:1790919516.069890:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919516.069897:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919516.069898:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790919516.069916:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.069941:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978204800:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.069966:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919516.070008:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204288 00000100:00100000:1.0:1790919516.070012:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204288 00000100:00100000:1.0:1790919516.070036:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978204800 00000100:00100000:1.0:1790919516.070038:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978204800 00010000:00080000:2.0:1790919516.070253:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b59a4e00 x1877914978205440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919516.070269:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919516.070415:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790919516.070469:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978204288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.070481:0:10757:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1790919516.070490:0:10757:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00080000:1.0:1790919516.070505:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919516.070515:0:6446:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1790919516.070524:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790919516.070529:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978204288:12345-0@lo:400:kworker.0 Request processed in 105us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.070534:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978204800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919516.070542:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:2.0:1790919516.070588:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac2a00 x1877914978205312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919516.070593:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978204800:12345-0@lo:400:kworker.0 Request processed in 60us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919516.070607:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790919516.070626:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978205312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919516.070642:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978204288:0@lo:400:kworker.0 00000100:00100000:2.0:1790919516.070648:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978204672:0@lo:400:kworker.0 00000100:00100000:1.0:1790919516.070661:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978204800:0@lo:400:kworker.0 00010000:00080000:2.0:1790919516.070666:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a01880 x1877914978205184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919516.070678:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978205184:0@lo:400:kworker.0 00000100:00100000:0.0:1790919516.071368:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978203776:12345-0@lo:400:kworker.0 Request processed in 5972us (7835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919516.071378:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1790919516.071410:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978203776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919516.075517:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978204160:12345-0@lo:400:kworker.0 Request processed in 9964us (11888us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919516.075531:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790919516.076386:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978204160:0@lo:400:kworker.0 00010000:00010000:3.0:1790919516.574739:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919517.596488:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919518.620375:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919519.132250:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919519.132319:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919519.132638:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205568 00000100:00100000:3.0:1790919519.132646:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205568 00000100:00100000:3.0:1790919519.132696:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790919519.132704:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919519.132745:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919519.132794:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919519.132801:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790919519.132853:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919519.133975:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919519.133990:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978205696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919519.134037:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919519.134099:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205696 00000100:00100000:2.0:1790919519.134105:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205696 00000100:00100000:2.0:1790919519.134136:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790919519.134143:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978205696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919519.134172:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919519.134210:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978205696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919519.134217:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790919519.134264:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978205696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919519.184870:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919519.184911:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919519.184942:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919519.184959:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919519.184982:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919519.185008:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197504 00000100:00100000:0.0:1790919519.185018:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197504 00000100:00100000:0.0:1790919519.185079:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 367 00000100:00100000:0.0:1790919519.185089:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958197504:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919519.185157:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958197504:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919519.185164:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 367 00000100:00100000:0.0:1790919519.185199:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197760 00000100:00100000:0.0:1790919519.185203:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197760 00000100:00100000:0.0:1790919519.185231:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198016 00000100:00100000:0.0:1790919519.185234:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198016 00000100:00100000:0.0:1790919519.185249:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197632 00000100:00100000:0.0:1790919519.185251:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197632 00000100:00100000:0.0:1790919519.185262:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958197888 00000100:00100000:0.0:1790919519.185264:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958197888 00000100:00100000:0.0:1790919519.185276:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:0.0:1790919519.185290:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958197760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919519.185321:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958197760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919519.185328:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:0.0:1790919519.185341:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1790919519.185347:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958198016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919519.185371:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958198016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919519.185377:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1790919519.185389:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:0.0:1790919519.185395:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958197632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919519.185418:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958197632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919519.185423:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:0.0:1790919519.185434:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:0.0:1790919519.185440:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958197888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919519.185462:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958197888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919519.185467:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00080000:0.0:1790919519.185616:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919519.185619:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1790919519.216427:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:2.0:1790919519.216435:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f3b65b4800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:0.0:1790919519.216503:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b4800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-OST0000 00000020:00000080:0.0:1790919519.216562:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65b7800 for lustre-OST0000 00000100:00100000:2.0:1790919519.644518:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919519.644614:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919519.644746:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919519.644956:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205824 00000100:00100000:3.0:1790919519.644965:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205824 00000100:00080000:0.0:1790919519.645014:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919519.645027:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790919519.645039:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978205824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919519.645104:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919519.645160:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978205824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919519.645167:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790919519.645226:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919519.645797:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919519.645809:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919519.645847:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919519.645943:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978205952 00000100:00100000:1.0:1790919519.645949:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978205952 00000100:00100000:1.0:1790919519.645997:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790919519.646006:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919519.646019:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919519.646084:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978205952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919519.646091:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1790919519.646143:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919519.646517:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978205952:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790919520.668422:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919520.989141:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790919520.990873:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919521.181677:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919521.181709:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978206080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919521.181813:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919521.181924:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206080 00000100:00100000:0.0:1790919521.181935:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206080 00000100:00100000:0.0:1790919521.182009:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790919521.182022:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978206080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919521.182111:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919521.182165:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978206080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919521.182172:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1790919521.182198:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790919521.182272:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3bc237100 x1877914978206080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919521.182293:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bc237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978206080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919521.182879:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978206592:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.182965:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919521.183001:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978207104:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.183029:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919521.183046:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978207616:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.183321:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919521.183345:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790919521.183352:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978206464:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.183377:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919521.183412:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978206976:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.183437:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919521.183451:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978207488:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.183474:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919521.183667:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206592 00000100:00100000:1.0:1790919521.183677:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206592 00000100:00100000:1.0:1790919521.183726:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790919521.183744:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978206592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919521.183813:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978206592:12345-0@lo:400:kworker.0 Request processed in 70us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919521.183822:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790919521.183919:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978206336:0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.183964:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919521.184000:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978206848:0@lo:400:kworker.0 00000100:00100000:1.0:1790919521.184551:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206336 00000100:00100000:1.0:1790919521.184559:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206336 00000100:00100000:1.0:1790919521.184599:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1790919521.184608:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978206336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919521.184658:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3461:x1877914978206336:12345-0@lo:400:kworker.0 Request processed in 51us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919521.184665:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1790919521.184799:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978206592:0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.184916:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978206208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919521.184957:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919521.184986:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978206720:0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185013:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919521.185034:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978207232:0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185279:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919521.185299:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978207744:0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185318:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919521.185358:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207104 00000100:00100000:0.0:1790919521.185364:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207104 00000100:00100000:0.0:1790919521.185409:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207616 00000100:00100000:0.0:1790919521.185413:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207616 00000100:00100000:0.0:1790919521.185430:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206464 00000100:00100000:0.0:1790919521.185434:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206464 00000100:00100000:0.0:1790919521.185446:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206976 00000100:00100000:0.0:1790919521.185449:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206976 00000100:00100000:0.0:1790919521.185463:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207488 00000100:00100000:0.0:1790919521.185466:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207488 00000100:00100000:0.0:1790919521.185482:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790919521.185490:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978207104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185555:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978207104:12345-0@lo:400:kworker.0 Request processed in 65us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919521.185563:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790919521.185579:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790919521.185586:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978207616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185616:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978207616:12345-0@lo:400:kworker.0 Request processed in 30us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919521.185622:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790919521.185634:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790919521.185640:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978206464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185667:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978206464:12345-0@lo:400:kworker.0 Request processed in 27us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919521.185684:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790919521.185696:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790919521.185703:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978206976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185735:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978206976:12345-0@lo:400:kworker.0 Request processed in 33us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919521.185741:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790919521.185751:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790919521.185757:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978207488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919521.185787:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978207488:12345-0@lo:400:kworker.0 Request processed in 30us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919521.185792:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790919521.185970:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206208 00000100:00100000:3.0:1790919521.185976:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206208 00000100:00100000:3.0:1790919521.186014:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790919521.186021:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978206208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919521.186042:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919521.186234:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919521.186270:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978207360:0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186308:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919521.186350:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978206336:0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186383:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207232 00000100:00100000:2.0:1790919521.186386:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207232 00000100:00100000:2.0:1790919521.186418:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207744 00000100:00100000:2.0:1790919521.186421:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207744 00000100:00100000:2.0:1790919521.186432:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207360 00000100:00100000:2.0:1790919521.186434:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207360 00000100:00100000:2.0:1790919521.186446:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790919521.186452:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978207232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186489:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978207232:12345-0@lo:400:kworker.0 Request processed in 37us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919521.186494:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790919521.186506:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919521.186511:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978207744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186546:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978207744:12345-0@lo:400:kworker.0 Request processed in 25us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919521.186552:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919521.186573:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790919521.186578:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978207360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186610:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978207360:12345-0@lo:400:kworker.0 Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919521.186615:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790919521.186649:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978207232:0@lo:400:kworker.0 00010000:00080000:2.0:1790919521.186662:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed85f80 x1877914978207744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790919537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919521.186674:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978207744:0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186698:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978207360:0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186714:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206848 00000100:00100000:2.0:1790919521.186716:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206848 00000100:00100000:2.0:1790919521.186740:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790919521.186746:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978206848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919521.186783:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978206848:12345-0@lo:400:kworker.0 Request processed in 37us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919521.186790:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790919521.186818:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978206848:0@lo:400:kworker.0 00000100:00100000:3.0:1790919521.186995:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978206208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 974us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919521.187003:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919521.187153:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978206720 00000100:00100000:1.0:1790919521.187159:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978206720 00000100:00100000:1.0:1790919521.187197:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790919521.187205:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978206720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919521.187248:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978206720:12345-0@lo:400:kworker.0 Request processed in 45us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919521.187255:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1790919521.187288:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919521.187294:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919521.187297:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919521.187300:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919521.187333:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978206464:0@lo:400:kworker.0 00000100:00100000:1.0:1790919521.187347:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978206976:0@lo:400:kworker.0 00000100:00100000:1.0:1790919521.187359:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978207488:0@lo:400:kworker.0 00010000:00080000:1.0:1790919521.187373:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5a1b800 x1877914978207104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919521.187392:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978207104:0@lo:400:kworker.0 00010000:00080000:1.0:1790919521.187411:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aed87800 x1877914978207616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919521.187418:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978207616:0@lo:400:kworker.0 00010000:00080000:2.0:1790919521.189023:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b59a5c00 x1877914978206208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919521.189439:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978206208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919521.189462:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978206720:0@lo:400:kworker.0 00010000:00010000:0.0:1790919521.699934:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919522.716215:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919523.743644:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919524.199392:0:13570:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:38:43 (1790919523) 00000100:00100000:2.0:1790919524.252477:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978207872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919524.252673:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919524.253234:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aed87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978208000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919524.253313:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919524.253494:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978207872 00000100:00100000:1.0:1790919524.253508:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978207872 00000100:00100000:1.0:1790919524.253563:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208000 00000100:00100000:1.0:1790919524.253566:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208000 00000100:00100000:1.0:1790919524.253585:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790919524.253594:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978207872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919524.253646:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1790919524.253703:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978207872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919524.253711:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790919524.253730:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790919524.253738:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978208000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919524.253757:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919524.253799:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978208000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919524.253807:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790919524.253882:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aed87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978208000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919524.254215:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978207872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919524.302026:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919524.304105:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198144 00000100:00100000:3.0:1790919524.304121:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198144 00000100:00100000:3.0:1790919524.304231:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 369 00000100:00100000:3.0:1790919524.304241:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958198144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919524.304329:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958198144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 89us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919524.304338:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 369 00000100:00100000:3.0:1790919524.304422:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919524.304562:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919524.304586:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919524.304633:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919524.304660:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198400 00000100:00100000:3.0:1790919524.304665:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198400 00000100:00100000:3.0:1790919524.305124:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198656 00000100:00100000:3.0:1790919524.305128:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198656 00000100:00100000:3.0:1790919524.305151:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198272 00000100:00100000:3.0:1790919524.305154:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198272 00000100:00100000:3.0:1790919524.305168:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198528 00000100:00100000:3.0:1790919524.305171:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198528 00000100:00100000:3.0:1790919524.305188:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:3.0:1790919524.305196:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aed87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958198400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919524.305250:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aed87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958198400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919524.305258:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:3.0:1790919524.305455:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:3.0:1790919524.305463:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958198656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919524.305495:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958198656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919524.305502:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:3.0:1790919524.305528:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:3.0:1790919524.305535:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958198272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919524.305569:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958198272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919524.305575:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:3.0:1790919524.305588:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:3.0:1790919524.305593:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958198528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919524.305628:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958198528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919524.305635:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00080000:3.0:1790919524.305664:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919524.305669:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919524.764391:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919524.764412:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978208128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919524.764481:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919524.764566:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208128 00000100:00100000:1.0:1790919524.764574:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208128 00000100:00100000:1.0:1790919524.764623:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919524.764632:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978208128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919524.764667:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919524.764712:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978208128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919524.764719:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919524.764830:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978208128:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790919524.764971:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919524.765676:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919524.771201:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978208256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919524.771271:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919524.772167:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208256 00000100:00100000:0.0:1790919524.772179:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208256 00000100:00100000:0.0:1790919524.772252:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790919524.772262:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978208256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919524.772295:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790919524.772376:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919524.775557:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978208256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3287us (4276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919524.775570:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790919524.776264:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978208256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790919525.788240:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919525.872552:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919525.872724:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198784 00000100:00100000:0.0:1790919525.872738:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198784 00000100:00100000:0.0:1790919525.872959:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919525.872972:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:11195:x1877914958198784:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919525.873000:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919525.873048:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159138eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bf3 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919525.873186:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad159138f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919525.873204:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad159138f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919525.873221:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad159138f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919525.873268:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919525.873272:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919525.873324:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad159138f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919525.873355:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159138eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bf3 expref: 7 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919525.873378:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad159138f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bf3 expref: 6 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919525.873388:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81c00) 00010000:00010000:0.0:1790919525.873391:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919525.873395:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015000, rc 0) 00000100:00100000:0.0:1790919525.873480:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:11195:x1877914958198784:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 510us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919525.873488:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1790919525.880188:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919525.880325:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958198912 00000100:00100000:3.0:1790919525.880341:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958198912 00000100:00100000:3.0:1790919525.880415:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:3.0:1790919525.880426:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:11196:x1877914958198912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919525.880454:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919525.880482:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad159138f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38bfa expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.880575:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.880593:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.880606:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.880622:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.880629:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.880658:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881131:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad1591390e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881144:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad1591390e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881153:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad1591390e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919525.881255:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919525.881259:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919525.881285:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad1591390e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881298:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881307:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881315:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881321:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919525.881326:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881335:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881357:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81c00) 00010000:00010000:3.0:1790919525.881360:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919525.881367:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881373:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881388:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881394:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881400:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881405:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919525.881408:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881414:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881420:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95f3904a5a00) 00010000:00010000:3.0:1790919525.881423:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919525.881425:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881431:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15913907 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881477:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad159138f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bfa expref: 8 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881492:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad1591390e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bfa expref: 7 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.881499:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:3.0:1790919525.881514:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919525.881517:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2dc00, rc 0) 00000100:00100000:3.0:1790919525.881608:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:11196:x1877914958198912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1184us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919525.881617:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1790919525.889156:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919525.889321:0:6456:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958199040 00000100:00100000:0.0:1790919525.889352:0:6456:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958199040 00000100:00100000:0.0:1790919525.889424:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790919525.889435:0:6456:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:11196:x1877914958199040:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790919525.889569:0:6456:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:11196:x1877914958199040:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 127us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919525.889579:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790919525.898288:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919525.898480:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958199296 00000100:00100000:3.0:1790919525.898494:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958199296 00000100:00100000:3.0:1790919525.898589:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1790919525.898600:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:11196:x1877914958199296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919525.898629:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919525.898656:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913915 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c01 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.898766:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.898784:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.898797:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.898832:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.898840:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.898848:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899314:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad1591392a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899326:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad1591392a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899334:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad1591392a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919525.899346:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790919525.899530:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899539:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899547:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899553:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919525.899558:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899579:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899593:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:3.0:1790919525.899596:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919525.899601:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899607:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591391c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899623:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899630:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899635:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899640:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919525.899643:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899648:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899654:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95f3904a5a00) 00010000:00010000:3.0:1790919525.899657:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919525.899659:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.899675:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913923 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.900329:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913915 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c01 expref: 10 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.900349:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad1591392a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c01 expref: 9 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919525.900356:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919525.900359:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919525.900362:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c000, rc 0) 00000100:00100000:3.0:1790919525.900460:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:11196:x1877914958199296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1860us (2187us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790919525.900471:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790919525.904533:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919525.904659:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958199424 00000100:00100000:3.0:1790919525.904670:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958199424 00000100:00100000:3.0:1790919525.904727:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790919525.904885:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:11196:x1877914958199424:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790919525.906235:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:11196:x1877914958199424:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 1347us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919525.906245:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1790919525.908186:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919525.908553:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958199552 00000100:00100000:3.0:1790919525.908572:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958199552 00000100:00100000:3.0:1790919525.908630:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1790919525.908640:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:11196:x1877914958199552:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1790919525.910684:0:10757:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2001us 00000100:00100000:3.0:1790919525.962497:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:11196:x1877914958199552:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 53847us (54310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919525.962529:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000040:00080000:2.0:1790919526.108994:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790919526.109831:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790919526.300510:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919526.300531:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978208384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919526.300603:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.300668:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208384 00000100:00100000:1.0:1790919526.300674:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208384 00000100:00100000:1.0:1790919526.300724:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790919526.300732:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978208384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919526.300765:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919526.300811:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978208384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919526.300827:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1790919526.300848:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790919526.300877:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2843ebb80 x1877914978208384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919526.300908:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978208384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919526.305126:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919526.305149:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978208512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919526.305226:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.305285:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208512 00000100:00100000:1.0:1790919526.305292:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208512 00000100:00100000:1.0:1790919526.305341:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790919526.305350:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978208512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919526.305373:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919526.305417:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978208512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919526.305425:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1790919526.305447:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790919526.305473:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b658f100 x1877914978208512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919526.305491:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978208512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919526.312755:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978209024:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.312826:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.312867:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978209536:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.312892:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.312935:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790919526.312942:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978208640:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.312974:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.312997:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978209152:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.313716:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978208896:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.321541:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919526.321594:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978209408:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.321638:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919526.321671:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978209920:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.321694:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919526.321724:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790919526.321733:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978208768:0@lo:400:kworker.0 00000100:00100000:3.0:1790919526.321741:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209408 00000100:00100000:3.0:1790919526.321752:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209408 00000100:00100000:2.0:1790919526.321761:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919526.321783:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978209280:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.321805:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919526.321816:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209920 00000100:00100000:3.0:1790919526.321821:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209920 00000100:00100000:2.0:1790919526.321825:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978209792:0@lo:400:kworker.0 00000100:00100000:3.0:1790919526.321845:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208768 00000100:00100000:3.0:1790919526.321850:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208768 00000100:00100000:3.0:1790919526.321865:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209280 00000100:00100000:2.0:1790919526.321867:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919526.321869:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209280 00000100:00100000:3.0:1790919526.321889:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209792 00000100:00100000:3.0:1790919526.321892:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209792 00000100:00100000:2.0:1790919526.321898:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209024 00000100:00100000:2.0:1790919526.321904:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209024 00000100:00100000:2.0:1790919526.321932:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208896 00000100:00100000:2.0:1790919526.321935:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208896 00000100:00100000:2.0:1790919526.321952:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790919526.321960:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978209024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.322011:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978209024:12345-0@lo:400:kworker.0 Request processed in 51us (9185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919526.322201:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790919526.322211:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978209408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919526.322253:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978209408:12345-0@lo:400:kworker.0 Request processed in 44us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919526.322259:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790919526.322277:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790919526.322282:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978209920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919526.322309:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978209920:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919526.322315:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790919526.322325:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790919526.322331:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978208768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919526.322357:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978208768:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919526.322362:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790919526.322373:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1790919526.322378:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978209280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919526.322415:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978209280:12345-0@lo:400:kworker.0 Request processed in 36us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919526.322421:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790919526.323046:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790919526.323067:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978209792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919526.323114:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978209792:12345-0@lo:400:kworker.0 Request processed in 61us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919526.323121:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790919526.324505:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790919526.324535:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790919526.324548:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978208896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.324615:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978208896:12345-0@lo:400:kworker.0 Request processed in 72us (3081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919526.324622:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790919526.324686:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978208768:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.324700:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978209280:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.324711:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978209792:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.324722:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978208896:0@lo:400:kworker.0 00010000:00080000:2.0:1790919526.324735:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecd9c00 x1877914978209408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919526.324745:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978209408:0@lo:400:kworker.0 00010000:00080000:2.0:1790919526.324756:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3aecda680 x1877914978209920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919526.324783:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978209920:0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.324847:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978208640 00000100:00100000:2.0:1790919526.324853:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978208640 00000100:00100000:2.0:1790919526.324882:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1790919526.324888:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978208640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919526.324924:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978208640:12345-0@lo:400:kworker.0 Request processed in 36us (11949us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919526.324930:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1790919526.324959:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209536 00000100:00100000:2.0:1790919526.324963:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209536 00000100:00100000:2.0:1790919526.324989:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919526.324994:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978209536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.330834:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.330909:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978209664:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.330976:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919526.331017:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209664 00000100:00100000:3.0:1790919526.331218:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978209152 00000100:00100000:3.0:1790919526.331226:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209152 00000100:00100000:3.0:1790919526.331276:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790919526.331286:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978209152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919526.331341:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978209152:12345-0@lo:400:kworker.0 Request processed in 57us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919526.331349:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790919526.331726:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978209536:12345-0@lo:400:kworker.0 Request processed in 6729us (18830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919526.331736:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919526.334693:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978209664 00000100:00100000:1.0:1790919526.334770:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919526.334780:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978209664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.334864:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978209664:12345-0@lo:400:kworker.0 Request processed in 85us (3887us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919526.334871:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1790919526.334892:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919526.334896:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919526.334899:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919526.334932:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978209664:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.334944:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978209024:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.334954:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978209536:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.334981:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978208640:0@lo:400:kworker.0 00000100:00100000:1.0:1790919526.334991:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978209152:0@lo:400:kworker.0 00010000:00010000:0.0:1790919526.813084:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919527.836209:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919527.985129:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919527.986253:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958199680 00000100:00100000:1.0:1790919527.986264:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958199680 00000100:00100000:1.0:1790919527.986339:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1790919527.986349:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:11239:x1877914958199680:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919527.986369:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919527.986388:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c08 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986449:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986463:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986474:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986498:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986506:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986513:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986674:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986682:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986689:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986703:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919527.986708:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986716:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986727:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81c00) 00010000:00010000:1.0:1790919527.986730:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919527.986734:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986740:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad1591393f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986751:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986756:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986761:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986766:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919527.986768:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986773:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986787:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95f392142400) 00010000:00010000:1.0:1790919527.986789:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919527.986792:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986798:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986827:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913938 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c08 expref: 10 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986836:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81c00) 00010000:00010000:1.0:1790919527.986838:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919527.986842:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c08 expref: 10 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919527.986851:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1ca00, rc 0) 00000100:00080000:0.0:1790919527.986997:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919527.987073:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:11239:x1877914958199680:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 725us (1953us total) trans 0 rc 301/301 00000100:00100000:1.0:1790919527.987081:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:3.0:1790919527.996651:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919527.996842:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958199936 00000100:00100000:2.0:1790919527.996852:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958199936 00000100:00100000:2.0:1790919527.997667:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1790919527.997679:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:11239:x1877914958199936:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:2.0:1790919527.997735:0:6446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919527.997760:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad159138f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bf3 expref: 9 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.997775:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81c00) 00010000:00010000:2.0:1790919527.997785:0:6446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919527.998009:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998023:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998034:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998046:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998077:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998084:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998912:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998923:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998930:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919527.998943:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000ba397d6 reply state 000000002a6bae11 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998953:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998960:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919527.998968:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919527.998972:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790919527.998978:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790919527.998987:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.998994:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999001:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999006:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919527.999011:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999018:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999026:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3930c1e00) 00010000:00010000:2.0:1790919527.999028:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919527.999031:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999037:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591394d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919527.999076:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000ba397d6 reply state 000000002a6bae11 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999085:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919527.999101:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95f3930c1d00) 00010000:00010000:2.0:1790919527.999103:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919527.999105:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790919527.999218:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:11239:x1877914958199936:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1540us (2574us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790919528.004317:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1790919528.053503:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.053703:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200064 00000100:00100000:3.0:1790919528.053713:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200064 00000100:00100000:3.0:1790919528.053778:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1790919528.053799:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:11247:x1877914958200064:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:3.0:1790919528.053825:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919528.053847:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c0f expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.053910:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913969 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.053976:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.053988:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919528.054024:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919528.054028:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919528.054205:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.054232:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c0f expref: 12 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.054259:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c0f expref: 11 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.054269:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:3.0:1790919528.054271:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919528.054275:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2cc00, rc 0) 00000100:00100000:3.0:1790919528.054644:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:11247:x1877914958200064:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 844us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919528.054662:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1790919528.120754:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.120852:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200192 00000100:00100000:2.0:1790919528.120863:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200192 00000100:00100000:2.0:1790919528.120981:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:2.0:1790919528.120992:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:11253:x1877914958200192:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919528.121023:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919528.121317:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c16 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121455:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121471:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121482:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121504:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121512:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121519:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121605:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913985 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121614:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121621:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919528.121646:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790919528.121650:0:13325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919528.121690:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121713:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121719:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121725:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121731:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919528.121736:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121744:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121756:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:3.0:1790919528.121759:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919528.121764:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121770:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2de00/0x951c50ad15913977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121782:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121788:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121794:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121810:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919528.121814:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121820:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121828:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95f3930c1d00) 00010000:00010000:3.0:1790919528.121830:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919528.121833:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121839:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad1591397e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121866:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15913970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c16 expref: 13 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121881:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913985 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c16 expref: 12 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.121962:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919528.121965:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790919528.121968:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c200, rc 0) 00000100:00100000:3.0:1790919528.122251:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:11253:x1877914958200192:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1260us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919528.122260:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1790919528.124945:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.125086:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200448 00000100:00100000:1.0:1790919528.125096:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200448 00000100:00100000:1.0:1790919528.125158:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:1.0:1790919528.125168:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:11253:x1877914958200448:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919528.125188:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919528.125208:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad1591398c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c1d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.125342:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.125357:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.125368:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.125422:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.125430:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.125437:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919528.125990:0:7785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790919528.126187:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126197:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126204:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126237:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126255:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126261:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126267:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919528.126272:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126280:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126292:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919528.126294:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919528.126299:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126305:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913993 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919528.126318:0:7785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a7de5357 reply state 000000001e11cdea transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126329:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126335:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142400) 00010000:00010000:1.0:1790919528.126338:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919528.126340:0:7785:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790919528.126369:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad1591398c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 15 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126390:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 14 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.126397:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:1.0:1790919528.126400:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919528.126402:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d800, rc 0) 00000100:00100000:1.0:1790919528.126465:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:11253:x1877914958200448:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1299us (1528us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790919528.126472:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:0.0:1790919528.129976:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.130167:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200576 00000100:00100000:3.0:1790919528.130191:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200576 00000100:00100000:3.0:1790919528.130239:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790919528.130247:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958200576:12345-192.168.203.11@tcp:8:bash.0 00010000:00080000:3.0:1790919528.130281:0:8248:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:3.0:1790919528.130313:0:8248:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad159139af 00002000:00100000:3.0:1790919528.130325:0:8248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fd078e75-25ee-44fe-89dc-39e9cfa5e4b5/ffff95f3a690a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790919528.130346:0:8248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790919528.130583:0:8248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790919528.130611:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f3a690e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919528.130772:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958200576:12345-192.168.203.11@tcp:8:bash.0 Request processed in 525us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919528.130780:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1790919528.134267:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.134305:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200704 00000100:00100000:2.0:1790919528.134315:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200704 00000100:00100000:2.0:1790919528.134379:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1790919528.134390:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958200704:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919528.134409:0:8082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919528.134437:0:8082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c24 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919528.134466:0:8082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919528.134496:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1790919528.134501:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919528.134535:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 7 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.134558:0:8082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 7 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.134573:0:8082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204aa00, rc 0) 00000100:00100000:2.0:1790919528.134622:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:0:x1877914958200704:12345-192.168.203.11@tcp:101:bash.0 Request processed in 235us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919528.134629:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00080000:2.0:1790919528.134672:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919528.138573:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919528.138669:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200832 00000100:00100000:0.0:1790919528.138680:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200832 00000100:00100000:0.0:1790919528.138741:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1790919528.138753:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:11253:x1877914958200832:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919528.138772:0:8084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919528.138793:0:8084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c2b expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.138825:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.138834:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919528.138839:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919528.138845:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.138879:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.138919:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919528.138934:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978210048:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919528.139189:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f392360540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919528.141322:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978210048:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919528.141356:0:8084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.141375:0:8084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015e00, rc 0) 00000100:00100000:2.0:1790919528.141434:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:11253:x1877914958200832:12345-192.168.203.11@tcp:101:bash.0 Request processed in 2683us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919528.141443:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790919528.145024:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919528.145255:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958200960 00000100:00100000:0.0:1790919528.145266:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958200960 00010000:00010000:0.0:1790919528.145446:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919528.145501:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790919528.145511:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958200960:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919528.145538:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919528.145561:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.145575:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.145599:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020287886/0x951c50ad159139b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c24 expref: 8 pid: 8082 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.145617:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919528.145633:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919528.145642:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.145653:0:13233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.145689:0:13233:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919528.145702:0:13233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13233:1877914978210176:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790919528.145796:0:13233:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f392360540 going to sleep for 11 seconds 00000100:00100000:0.0:1790919528.150222:0:13233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13233:1877914978210176:192.168.203.11@tcp:105: 00010000:00010000:0.0:1790919528.150247:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919528.150731:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958200960:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5219us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919528.150742:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1790919528.153167:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.153478:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958201216 00000100:00100000:2.0:1790919528.153496:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958201216 00000100:00100000:2.0:1790919528.153554:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1790919528.153563:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:11253:x1877914958201216:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1790919528.153894:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:11253:x1877914958201216:12345-192.168.203.11@tcp:35:bash.0 Request processed in 331us (735us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790919528.153920:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919528.255495:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919528.255719:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958201472 00000100:00100000:0.0:1790919528.255728:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958201472 00000100:00100000:0.0:1790919528.255789:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1790919528.255799:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:11263:x1877914958201472:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919528.255825:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919528.255845:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159139c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c32 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919528.255939:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790919528.256096:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159139c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c32 expref: 18 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.256109:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:0.0:1790919528.256112:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919528.256117:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad159139c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c32 expref: 18 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.256140:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015800, rc 0) 00000100:00100000:0.0:1790919528.256209:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:11263:x1877914958201472:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 412us (733us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1790919528.256217:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1790919528.260685:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.260764:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958201728 00000100:00100000:1.0:1790919528.260775:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958201728 00000100:00100000:1.0:1790919528.260830:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790919528.260840:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:11263:x1877914958201728:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919528.261097:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:11263:x1877914958201728:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 258us (421us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790919528.261104:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790919528.335723:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.335822:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958201856 00000100:00100000:2.0:1790919528.335834:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958201856 00000100:00100000:2.0:1790919528.335895:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1790919528.335904:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:11269:x1877914958201856:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919528.335929:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919528.335950:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159139d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c39 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.336013:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad159139d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.336026:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad159139d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.336037:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad159139d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919528.336106:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790919528.336110:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919528.336355:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad159139d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.336381:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159139d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c39 expref: 20 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.336398:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad159139d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c39 expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.336424:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919528.336426:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919528.336430:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697200, rc 0) 00000100:00100000:2.0:1790919528.336494:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11269:x1877914958201856:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 582us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919528.336501:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1790919528.340017:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.340219:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958202112 00000100:00100000:1.0:1790919528.340229:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958202112 00000100:00100000:1.0:1790919528.340295:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1790919528.340305:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11269:x1877914958202112:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919528.340325:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919528.340362:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159139e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c40 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.340460:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad159139e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.340474:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad159139e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.340494:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad159139e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919528.340504:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790919528.340643:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159139e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c40 expref: 22 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.340663:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad159139e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c40 expref: 21 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.340671:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:1.0:1790919528.340674:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919528.340678:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1ca00, rc 0) 00000100:00100000:1.0:1790919528.340747:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11269:x1877914958202112:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 443us (737us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790919528.340755:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790919528.345440:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.345517:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958202240 00000100:00100000:1.0:1790919528.345535:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958202240 00000100:00100000:1.0:1790919528.345599:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790919528.345610:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:2414:x1877914958202240:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919528.345637:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919528.345661:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad159139e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c40 expref: 21 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.345680:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:1.0:1790919528.345684:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919528.345740:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:2414:x1877914958202240:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 133us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919528.345748:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919528.348502:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.348676:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958202496 00000100:00100000:3.0:1790919528.348685:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958202496 00000100:00100000:3.0:1790919528.348775:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790919528.348784:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11269:x1877914958202496:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919528.348808:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919528.348828:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159139f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c47 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.348931:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159139fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.348947:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159139fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.348959:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159139fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919528.348986:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790919528.349157:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159139f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c47 expref: 23 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.349175:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159139fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c47 expref: 22 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.349184:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:3.0:1790919528.349187:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790919528.349191:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d200, rc 0) 00000100:00100000:3.0:1790919528.349243:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11269:x1877914958202496:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 459us (759us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790919528.349251:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1790919528.354648:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.354772:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958202624 00000100:00100000:1.0:1790919528.354781:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958202624 00000100:00100000:1.0:1790919528.354842:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1790919528.354852:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958202624:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:1.0:1790919528.354907:0:8082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.354927:0:8082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.354935:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919528.354939:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919528.354944:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.354978:0:8082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.355005:0:8082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 7 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919528.355022:0:8082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8082:1877914978210304:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919528.355129:0:8082:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3812ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919528.358735:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.358873:0:8082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3aecd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8082:1877914978210304:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919528.358910:0:8082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919528.359035:0:8088:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958202752 00000100:00100000:2.0:1790919528.359042:0:8088:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958202752 00002000:00100000:2.0:1790919528.359126:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff95f3b64fa300 x1877914958202752/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:649/0 lens 504/0 e 0 to 0 dl 1790919539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919528.359135:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f3b64fa300 with x1877914958202752 ext(0->12) 00010000:00010000:2.0:1790919528.359142:0:8088:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 8 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.359155:0:8088:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 8 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919528.359161:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f3b64fa300 00000100:00100000:2.0:1790919528.359186:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790919528.359194:0:8088:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958202752:12345-192.168.203.11@tcp:4:lfs.0 00000001:00100000:1.0:1790919528.385991:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000100:00100000:2.0:1790919528.386806:0:8088:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2413:x1877914958202752:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 27605us (28072us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790919528.386819:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:2.0:1790919528.386832:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff95f3b64fa300 x1877914958202752/t4294967300(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:649/0 lens 504/448 e 0 to 0 dl 1790919539 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919528.386852:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f3b64fa300 with x1877914958202752 ext(0->12) 00010000:00010000:2.0:1790919528.386863:0:8088:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 9 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.386946:0:8088:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 9 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919528.386955:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f3b64fa300 00000100:00100000:0.0:1790919528.390215:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.390363:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958202880 00000100:00100000:2.0:1790919528.390373:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958202880 00010000:00010000:2.0:1790919528.390409:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 9 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919528.390495:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1790919528.390505:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958202880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919528.390520:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790919528.390596:0:12731:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790919528.390600:0:12731:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790919528 00002000:00010000:2.0:1790919528.390602:0:12731:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790919529 00002000:00010000:2.0:1790919528.390604:0:12731:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790919528 00010000:00010000:2.0:1790919528.390609:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 9 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.390622:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 9 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.390663:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad159139bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c2b expref: 9 pid: 8084 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.390678:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919528.390682:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919528.390688:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.390698:0:12731:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.390730:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919528.390856:0:8082:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390866:0:8082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390900:0:8082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390909:0:8082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390917:0:8082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390937:0:8082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1da00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919528.390941:0:8082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390951:0:8082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390965:0:8082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.390973:0:8082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005afc81cc/0x951c50ad15913a0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919528.391037:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958202880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 533us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919528.391045:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1790919528.391420:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958202624:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 36568us (36779us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919528.391429:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1790919528.393903:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.394023:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958203136 00000100:00100000:1.0:1790919528.394032:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958203136 00000100:00100000:3.0:1790919528.394893:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919528.394906:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11269:x1877914958203136:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:3.0:1790919528.394970:0:6448:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159139fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c47 expref: 22 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919528.395297:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1790919528.395346:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1790919528.395824:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1790919528.395876:0:6448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.395892:0:6448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 26 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.395912:0:6448:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.395957:0:6448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 26 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.395974:0:6448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 26 pid: 7785 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919528.395989:0:6448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6448:1877914978210432:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919528.396095:0:6448:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919528.399448:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.399537:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958203264 00000100:00100000:2.0:1790919528.399547:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958203264 00010000:00010000:2.0:1790919528.399587:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 27 pid: 7785 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919528.399649:0:6448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6448:1877914978210432:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919528.399673:0:6448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919528.399705:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1790919528.399715:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:2413:x1877914958203264:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919528.399735:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919528.399808:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 27 pid: 7785 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.399839:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 27 pid: 7785 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.399859:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159139a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c1d expref: 27 pid: 7785 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.399876:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:2.0:1790919528.399880:0:6430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.399960:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.399969:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.400000:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919528.400247:0:6448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.400255:0:6448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919528.400370:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1790919528.400612:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:2413:x1877914958203264:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 897us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919528.400620:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000001:00080000:2.0:1790919528.402671:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1790919528.402984:0:6448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6448:1877914978210560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790919528.403248:0:6448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919528.403316:0:6448:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919528.403357:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978210560 00000100:00100000:1.0:1790919528.403364:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978210560 00000100:00100000:1.0:1790919528.403501:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790919528.403510:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6448:x1877914978210560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790919528.403646:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6448:x1877914978210560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919528.403654:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1790919528.403747:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919528.403866:0:6448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286d86a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6448:1877914978210560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790919528.404506:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1790919528.404667:0:6448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6448:1877914978210688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790919528.404707:0:6448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919528.404857:0:6448:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39141fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919528.404927:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978210688 00000100:00100000:3.0:1790919528.404934:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978210688 00000100:00100000:3.0:1790919528.404976:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790919528.404985:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6448:x1877914978210688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790919528.405205:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6448:x1877914978210688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 221us (497us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790919528.405221:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790919528.405263:0:6448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6448:1877914978210688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790919528.405306:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1790919528.405342:0:6448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.405353:0:6448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.405360:0:6448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.405367:0:6448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919528.405372:0:6448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.405381:0:6448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.405395:0:6448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:3.0:1790919528.405399:0:6448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790919528.405403:0:6448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.405409:0:6448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a11 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919528.406322:0:6448:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790919528.407253:0:6448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790919528.407268:0:6448:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337435214615ns, next at 338435212110ns, rc = 0 00000001:00080000:2.0:1790919528.407277:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1790919528.407339:0:6448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142f00) 00010000:00010000:2.0:1790919528.407342:0:6448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790919528.407351:0:6448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159139fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c47 expref: 30 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919528.407513:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11269:x1877914958203136:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 12610us (13625us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1790919528.407522:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000020:00080000:2.0:1790919528.407588:0:6448:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790919528.410843:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.411018:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958203392 00000100:00100000:3.0:1790919528.411028:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958203392 00000100:00100000:3.0:1790919528.411304:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1790919528.411315:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11269:x1877914958203392:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919528.411342:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919528.411362:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913a18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c4e expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.411420:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913a18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c4e expref: 30 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.411434:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913a18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c4e expref: 30 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.411454:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919528.411457:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919528.411461:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166cc00, rc 0) 00000100:00100000:3.0:1790919528.411538:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:11269:x1877914958203392:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 224us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919528.411545:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1790919528.414386:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919528.414501:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958203648 00000100:00100000:0.0:1790919528.414511:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958203648 00000100:00100000:0.0:1790919528.414574:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790919528.414584:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390322050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:11269:x1877914958203648:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790919528.414818:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390322050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11269:x1877914958203648:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 236us (440us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1790919528.414826:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790919528.501747:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.501837:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958203904 00000100:00100000:1.0:1790919528.501846:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958203904 00000100:00100000:1.0:1790919528.501902:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1790919528.501912:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11279:x1877914958203904:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919528.501938:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919528.501958:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c55 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919528.502045:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790919528.502358:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913a1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c55 expref: 33 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.502372:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:1.0:1790919528.502375:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919528.502380:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c55 expref: 33 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.502394:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c800, rc 0) 00000100:00100000:1.0:1790919528.502452:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:11279:x1877914958203904:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 542us (724us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1790919528.502459:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1790919528.504498:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.504652:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958204032 00000100:00100000:3.0:1790919528.504663:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958204032 00000100:00100000:3.0:1790919528.504725:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1790919528.504737:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:11279:x1877914958204032:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1790919528.504817:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504837:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504871:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504884:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504892:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504898:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504982:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504991:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.504997:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919528.505036:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505048:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505080:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505087:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505103:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919528.505109:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505117:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505130:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919528.505134:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919528.505139:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505145:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505159:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505165:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505170:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505175:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919528.505178:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505184:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505201:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142400) 00010000:00010000:3.0:1790919528.505203:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919528.505206:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505212:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505221:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505227:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505232:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505236:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919528.505239:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505244:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505249:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919528.505251:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919528.505254:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.505258:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919528.505333:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:11279:x1877914958204032:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 599us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919528.505404:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1790919528.518675:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.519086:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958204288 00000100:00100000:2.0:1790919528.519096:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958204288 00000100:00100000:2.0:1790919528.519157:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1790919528.519167:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:11279:x1877914958204288:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919528.519684:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+33:11279:x1877914958204288:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 516us (1015us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1790919528.519693:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919528.558234:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.558392:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958204544 00000100:00100000:2.0:1790919528.558402:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958204544 00000100:00100000:2.0:1790919528.558456:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790919528.558466:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+33:11282:x1877914958204544:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919528.558499:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919528.558520:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913a42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c5c expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.558995:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559012:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559041:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559078:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559087:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559093:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559202:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559211:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559218:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919528.559228:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790919528.559314:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559322:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559329:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559335:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919528.559651:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559660:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559672:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919528.559675:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919528.559680:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559687:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913a49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559700:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559706:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559712:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559717:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919528.559720:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559726:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559732:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142400) 00010000:00010000:2.0:1790919528.559735:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919528.559743:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559749:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559793:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913a42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 36 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559808:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 35 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.559816:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919528.559818:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919528.559821:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919528.559996:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:11282:x1877914958204544:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1531us (1769us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790919528.560004:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1790919528.564652:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919528.564736:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958204672 00000100:00100000:0.0:1790919528.564745:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958204672 00000100:00100000:0.0:1790919528.564800:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1790919528.564810:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:11282:x1877914958204672:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790919528.564872:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.564980:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.564991:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565015:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565022:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565029:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565047:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919528.565115:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565125:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565254:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919528.565257:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919528.565262:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919528.565268:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913a65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919528.565407:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:11282:x1877914958204672:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 597us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919528.565415:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1790919528.567995:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.568223:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958204928 00000100:00100000:3.0:1790919528.568232:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958204928 00000100:00100000:2.0:1790919528.568421:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790919528.568431:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:11282:x1877914958204928:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919528.568679:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:11282:x1877914958204928:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 249us (689us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790919528.568686:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790919528.784595:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.784798:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958205184 00000100:00100000:3.0:1790919528.784809:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958205184 00000100:00100000:3.0:1790919528.784970:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790919528.784981:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:11313:x1877914958205184:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1790919528.785004:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919528.785024:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c63 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.785177:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.785192:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.785204:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919528.785215:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790919528.785369:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c63 expref: 39 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.785388:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c63 expref: 38 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.785415:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919528.785418:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919528.785422:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166de00, rc 0) 00000100:00100000:3.0:1790919528.785494:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11313:x1877914958205184:12345-192.168.203.11@tcp:101:cat.0 Request processed in 503us (895us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790919528.785501:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:1.0:1790919528.788981:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919528.789038:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919528.789306:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958205440 00000100:00100000:0.0:1790919528.789315:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958205440 00000100:00100000:0.0:1790919528.789401:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919528.789410:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11313:x1877914958205440:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:0.0:1790919528.789721:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:11313:x1877914958205440:12345-192.168.203.11@tcp:35:cat.0 Request processed in 305us (741us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1790919528.789728:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790919528.790446:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958205568 00000100:00100000:2.0:1790919528.790455:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958205568 00000100:00100000:2.0:1790919528.790535:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919528.790544:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:2414:x1877914958205568:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919528.790571:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919528.790594:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913a73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c63 expref: 39 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.790612:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919528.790617:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919528.790657:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:2414:x1877914958205568:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 114us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919528.790663:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790919528.843609:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.843698:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958205824 00000100:00100000:3.0:1790919528.843708:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958205824 00000100:00100000:3.0:1790919528.843850:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1790919528.843859:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11319:x1877914958205824:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790919528.843884:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919528.843887:0:13325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790919528.843912:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad159139d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c39 expref: 38 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.843930:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919528.843935:0:13325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919528.843948:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a81 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c6a expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.844563:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.844582:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 38 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.844610:0:13325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.844647:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 38 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.844660:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 38 pid: 6445 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919528.844675:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978210816:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919528.844761:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919528.850250:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978210816:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919528.850280:0:13325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919528.851618:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919528.851697:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958205952 00000100:00100000:3.0:1790919528.851707:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958205952 00010000:00010000:3.0:1790919528.851856:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 39 pid: 6445 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919528.851976:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:3.0:1790919528.851985:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:2414:x1877914958205952:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919528.852012:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919528.852019:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 39 pid: 6445 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.852079:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 39 pid: 6445 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.852285:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913a57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c5c expref: 39 pid: 6445 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.852301:0:6432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919528.852306:0:6432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.852314:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.852320:0:6432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919528.852349:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919528.852402:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:2414:x1877914958205952:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 418us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919528.852409:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00010000:00010000:1.0:1790919528.852880:0:13325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.852889:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919528.852906:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790919528.853308:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913a81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 39 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.853327:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 38 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919528.853335:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:1.0:1790919528.853338:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919528.853341:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c200, rc 0) 00000100:00100000:1.0:1790919528.853396:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11319:x1877914958205824:12345-192.168.203.11@tcp:101:dd.0 Request processed in 9538us (9796us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1790919528.853403:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1790919528.858908:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919528.864279:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958206208 00000100:00100000:2.0:1790919528.864294:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958206208 00000100:00100000:2.0:1790919528.864360:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1790919528.864370:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11319:x1877914958206208:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:2.0:1790919528.864642:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.864660:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.864671:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919528.864729:0:6446:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1790919528.864760:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce2881fb reply state 00000000c2c71d44 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.864772:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919528.864797:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919528.864799:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919528.864803:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919528.865309:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+41:11319:x1877914958206208:12345-192.168.203.11@tcp:36:dd.0 Request processed in 937us (6408us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1790919528.865318:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000020:00080000:2.0:1790919528.865324:0:6446:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790919528.865610:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919529.095139:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919529.095229:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958206336 00000100:00100000:3.0:1790919529.095258:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958206336 00000100:00080000:2.0:1790919529.095352:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919529.095358:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:3.0:1790919529.095376:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+41:11333:x1877914958206336:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:3.0:1790919529.095409:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919529.095439:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913a9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c71 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095564:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095583:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095598:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095611:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095619:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095626:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095738:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095750:0:10757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 42 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095760:0:10757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095805:0:10757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 42 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.095836:0:10757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 42 pid: 13325 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919529.095855:0:10757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978210944:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919529.098368:0:10757:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919529.111326:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.111458:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958206592 00000100:00100000:2.0:1790919529.111472:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958206592 00000100:00100000:2.0:1790919529.111557:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790919529.111568:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:10893:x1877914958206592:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790919529.111985:0:10757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978210944:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919529.112014:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:10893:x1877914958206592:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 444us (698us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790919529.112025:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00010000:00010000:3.0:1790919529.112032:0:10757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919529.125225:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.125353:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958206720 00000100:00100000:0.0:1790919529.125363:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958206720 00010000:00010000:0.0:1790919529.125409:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 44 pid: 13325 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919529.125458:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1790919529.125468:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:2413:x1877914958206720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919529.125494:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919529.125502:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 44 pid: 13325 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.125515:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 44 pid: 13325 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.125548:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913a88 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c6a expref: 44 pid: 13325 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.125566:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.125571:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.125581:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.125588:0:13233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.125678:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919529.125745:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:2413:x1877914958206720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 278us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.125767:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00010000:00010000:3.0:1790919529.129293:0:10757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.129312:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.132428:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790919529.132438:0:10757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919529.132511:0:10757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132532:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132544:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132551:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132559:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132565:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.132570:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132578:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132593:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919529.132596:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.132601:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132800:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913aa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132827:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132833:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132840:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132845:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.132849:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132855:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132864:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142400) 00010000:00010000:0.0:1790919529.132866:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.132869:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.132987:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913aab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.133027:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913a9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c71 expref: 43 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.133042:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c71 expref: 42 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.133219:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.133221:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919529.133224:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ca00, rc 0) 00000100:00100000:0.0:1790919529.133328:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+42:11333:x1877914958206336:12345-192.168.203.11@tcp:101:stat.0 Request processed in 37958us (38196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.133337:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1790919529.214327:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.214445:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958206976 00000100:00100000:2.0:1790919529.214455:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958206976 00000100:00100000:2.0:1790919529.214594:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790919529.214604:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+42:11339:x1877914958206976:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:2.0:1790919529.214659:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919529.214687:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ab2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c71 expref: 42 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.214706:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919529.214712:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919529.214963:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.214983:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.214993:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919529.215049:0:6445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1790919529.215129:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004574c283 reply state 000000008a8c12ac transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.215142:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.215148:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919529.215151:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919529.215154:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919529.215276:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:11339:x1877914958206976:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 673us (958us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790919529.215284:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000020:00080000:2.0:1790919529.215289:0:6445:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790919529.373026:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978211072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919529.373118:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919529.373321:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978211072 00000100:00100000:0.0:1790919529.373330:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978211072 00000100:00100000:0.0:1790919529.374922:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790919529.374942:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978211072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919529.374986:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919529.375071:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978211072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.375079:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790919529.375170:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978211200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919529.375206:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919529.375247:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978211200 00000100:00100000:0.0:1790919529.375253:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978211200 00000100:00100000:0.0:1790919529.375279:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919529.375285:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978211200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919529.375725:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919529.375773:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978211200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 487us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.375780:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919529.375823:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978211200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919529.381525:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978211072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919529.385526:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919529.385589:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958207104 00000100:00100000:3.0:1790919529.385601:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958207104 00000100:00100000:3.0:1790919529.385656:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1790919529.385665:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:11353:x1877914958207104:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:3.0:1790919529.385692:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919529.385713:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913ac0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c78 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.385795:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.385811:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.385822:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.385834:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.385842:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.385850:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386260:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386271:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386279:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919529.386315:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790919529.386320:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919529.386350:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386373:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386382:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386389:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386396:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386403:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919529.386407:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386415:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386427:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919529.386431:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919529.386435:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386442:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ac7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386455:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386462:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386473:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386492:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919529.386495:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386502:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386510:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142400) 00010000:00010000:3.0:1790919529.386513:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919529.386516:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386523:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913ace lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386550:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913ac0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 46 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386563:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 45 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919529.386570:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919529.386573:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919529.386575:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166da00, rc 0) 00000100:00100000:3.0:1790919529.386639:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+45:11353:x1877914958207104:12345-192.168.203.11@tcp:101:stat.0 Request processed in 974us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919529.386657:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1790919529.429712:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.429758:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.429785:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.429808:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.429831:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.429859:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958207488 00000100:00100000:0.0:1790919529.429869:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958207488 00000100:00100000:0.0:1790919529.429925:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:0.0:1790919529.429935:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958207488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919529.430007:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958207488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.430014:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:0.0:1790919529.430039:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958207744 00000100:00100000:0.0:1790919529.430043:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958207744 00000100:00100000:0.0:1790919529.430097:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958207360 00000100:00100000:0.0:1790919529.430101:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958207360 00000100:00100000:0.0:1790919529.430121:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958207616 00000100:00100000:0.0:1790919529.430124:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958207616 00000100:00100000:0.0:1790919529.430149:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:0.0:1790919529.430156:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958207744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919529.430186:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958207744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.430193:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:0.0:1790919529.430206:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:0.0:1790919529.430212:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958207360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919529.430235:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958207360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.430250:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:0.0:1790919529.430264:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:0.0:1790919529.430271:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958207616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919529.430314:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958207616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.430320:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00080000:0.0:1790919529.430346:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919529.430351:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919529.430782:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958207232 00000100:00100000:3.0:1790919529.430787:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958207232 00000100:00100000:3.0:1790919529.430825:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 371 00000100:00100000:3.0:1790919529.430832:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958207232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919529.430867:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958207232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919529.430872:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 371 00000001:00080000:2.0:1790919529.441356:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967334 is committed 00000020:00080000:2.0:1790919529.441379:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f39141fd80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1790919529.441384:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3be3d8400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f39141f000 00000020:00080000:2.0:1790919529.441388:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3be3d8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f3c215a000 00000001:00080000:2.0:1790919529.441411:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:2.0:1790919529.441429:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:2.0:1790919529.441465:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1790919529.441548:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1790919529.441672:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1790919529.441713:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441726:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441749:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441754:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919529.441759:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441767:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441782:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95f3930c1d00) 00010000:00010000:1.0:1790919529.441786:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919529.441791:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441798:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15913954 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441816:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441822:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441827:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441832:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ae00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919529.441835:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441851:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441859:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919529.441862:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919529.441864:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441870:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591395b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441961:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441967:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441974:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441978:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919529.441981:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441987:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.441995:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142400) 00010000:00010000:1.0:1790919529.441998:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919529.442001:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.442013:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad1591399a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919529.442194:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1790919529.442303:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442311:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442317:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442322:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.442325:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442332:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442341:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.442344:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.442347:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442363:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913a96 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442380:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442386:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442391:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442396:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.442400:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442405:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442413:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.442414:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.442417:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.442422:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913ab9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919529.442466:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978211328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790919529.442543:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919529.442655:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978211328 00000100:00100000:2.0:1790919529.442668:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978211328 00000100:00100000:2.0:1790919529.442741:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790919529.442751:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978211328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790919529.442776:0:8083:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1790919529.442805:0:8083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6abf4368, atime: 0x6abf4369, ctime: 0x6abf4368, blocks: 0x1 00010000:00010000:2.0:1790919529.442812:0:8083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.442825:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1790919529.442829:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919529.442835:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.442849:0:8083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.442857:0:8083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.442864:0:8083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.442949:0:8083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919529.443514:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919529.443521:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.443544:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919529.443548:0:6434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.443556:0:6434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.443570:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.443578:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15913adc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.443594:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919529.443596:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919529.443598:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919529.443763:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3461:x1877914978211328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1012us (1218us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790919529.443771:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1790919529.443872:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f3b5a6b800/2, rc 0, transno 4294967302 00000100:00100000:3.0:1790919529.443952:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978211328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790919529.467958:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919529.468097:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958208000 00000100:00100000:1.0:1790919529.468107:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958208000 00000100:00100000:1.0:1790919529.468168:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1790919529.468177:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:11363:x1877914958208000:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919529.468199:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919529.468219:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913ae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c7f expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919529.468311:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790919529.468574:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913ae3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c7f expref: 13 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.468588:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:1.0:1790919529.468591:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919529.468596:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913ae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c7f expref: 13 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.468609:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d000, rc 0) 00000100:00100000:1.0:1790919529.468673:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:11363:x1877914958208000:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 497us (724us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1790919529.468681:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1790919529.473289:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.473505:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958208256 00000100:00100000:2.0:1790919529.473548:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958208256 00000100:00100000:2.0:1790919529.473601:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790919529.473611:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:11363:x1877914958208256:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919529.473853:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11363:x1877914958208256:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 243us (572us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1790919529.473860:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790919529.535229:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.535371:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958208512 00000100:00100000:0.0:1790919529.535381:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958208512 00000100:00100000:0.0:1790919529.535447:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790919529.535457:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11369:x1877914958208512:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919529.535490:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919529.535511:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913af1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c86 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.535615:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.535649:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 14 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.535657:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.535690:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 14 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.535703:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 14 pid: 7785 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919529.535716:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978211456:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919529.535798:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919529.539883:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.540166:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978211456:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919529.540194:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919529.541325:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958208640 00000100:00100000:2.0:1790919529.541337:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958208640 00010000:00010000:2.0:1790919529.541382:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 15 pid: 7785 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919529.541498:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790919529.541509:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:2413:x1877914958208640:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919529.541534:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919529.541542:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 15 pid: 7785 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.541554:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 15 pid: 7785 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.541575:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913ad5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c78 expref: 15 pid: 7785 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.541594:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919529.541599:0:6431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.541635:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.541644:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.541676:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919529.541739:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:2413:x1877914958208640:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 232us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919529.541746:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00010000:00010000:0.0:1790919529.541835:0:6445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.541844:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.541864:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790919529.542024:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913af1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 15 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.542080:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 14 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.542089:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.542091:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919529.542094:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015800, rc 0) 00000100:00100000:0.0:1790919529.542126:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:11369:x1877914958208512:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6670us (6906us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790919529.542134:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790919529.545247:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.545355:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958208896 00000100:00100000:0.0:1790919529.545365:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958208896 00000100:00100000:0.0:1790919529.545424:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1790919529.545434:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:11369:x1877914958208896:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:0.0:1790919529.545718:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.545732:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.545741:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919529.545778:0:6446:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1790919529.545795:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bf9c4aee reply state 00000000d2135871 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.545804:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.545821:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.545823:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790919529.545826:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919529.545896:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:11369:x1877914958208896:12345-192.168.203.11@tcp:36:bash.0 Request processed in 464us (659us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1790919529.545903:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000020:00080000:0.0:1790919529.545909:0:6446:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790919529.551308:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919529.551410:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958209024 00000100:00100000:1.0:1790919529.551420:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958209024 00000100:00100000:1.0:1790919529.551487:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790919529.551511:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:11369:x1877914958209024:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919529.551542:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919529.551561:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913b0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c8d expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.551640:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.551655:0:6447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 18 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.551663:0:6447:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.551696:0:6447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 18 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919529.551715:0:6447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 18 pid: 6445 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919529.551730:0:6447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978211584:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919529.551815:0:6447:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919529.558418:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.558620:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958209152 00000100:00100000:2.0:1790919529.558629:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958209152 00000100:00100000:0.0:1790919529.558642:0:6447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978211584:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919529.558667:0:6447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558668:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 19 pid: 6445 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919529.558749:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:2.0:1790919529.558760:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:2413:x1877914958209152:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919529.558775:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919529.558782:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 19 pid: 6445 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558793:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 19 pid: 6445 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558814:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913af8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c86 expref: 19 pid: 6445 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558848:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919529.558853:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558862:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558871:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.558913:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919529.558986:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2413:x1877914958209152:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 227us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919529.559001:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00010000:00010000:0.0:1790919529.559074:0:6447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.559081:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.559138:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790919529.559143:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919529.559163:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.559193:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913b0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c8d expref: 18 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.559207:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c8d expref: 17 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.559226:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.559235:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919529.559239:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1de00, rc 0) 00000100:00100000:0.0:1790919529.559278:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:11369:x1877914958209024:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7769us (7979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.559290:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790919529.563399:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.563561:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958209408 00000100:00100000:2.0:1790919529.563572:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958209408 00000100:00100000:2.0:1790919529.563628:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1790919529.563638:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390321c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:11369:x1877914958209408:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1790919529.563888:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390321c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:11369:x1877914958209408:12345-192.168.203.11@tcp:35:bash.0 Request processed in 243us (490us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790919529.563903:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790919529.656368:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.656472:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958209664 00000100:00100000:0.0:1790919529.656494:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958209664 00000100:00100000:0.0:1790919529.656556:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790919529.656566:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:11379:x1877914958209664:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919529.656591:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919529.656611:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c94 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.656701:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790919529.656823:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c94 expref: 20 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.656837:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:0.0:1790919529.656840:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919529.656860:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c94 expref: 20 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.656885:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015c00, rc 0) 00000100:00100000:0.0:1790919529.656948:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11379:x1877914958209664:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 383us (589us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1790919529.656956:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:1.0:1790919529.659576:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.659659:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958209792 00000100:00100000:0.0:1790919529.659685:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958209792 00000100:00100000:0.0:1790919529.659744:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1790919529.659754:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11379:x1877914958209792:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790919529.659828:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.659858:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.659871:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.659892:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.659899:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.659905:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660241:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660252:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660259:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919529.660303:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660328:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660335:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660342:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660348:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.660353:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660361:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660373:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919529.660376:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.660380:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660387:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660399:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660405:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660411:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660421:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.660424:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660430:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660437:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81f00) 00010000:00010000:0.0:1790919529.660440:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.660442:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660449:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660463:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660469:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660486:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660491:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.660494:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660500:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660518:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.660520:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.660524:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.660530:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919529.660618:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11379:x1877914958209792:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 864us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.660627:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1790919529.664314:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.665483:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958210048 00000100:00100000:2.0:1790919529.665496:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958210048 00000100:00100000:2.0:1790919529.665562:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790919529.665574:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11379:x1877914958210048:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919529.665813:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11379:x1877914958210048:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 241us (1519us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790919529.665833:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790919529.709709:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.709839:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958210304 00000100:00100000:0.0:1790919529.709849:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958210304 00000100:00100000:0.0:1790919529.710037:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:0.0:1790919529.710048:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11382:x1877914958210304:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919529.710110:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919529.710129:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38c9b expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710198:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710212:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710222:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710235:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710250:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710263:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710580:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710591:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710599:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.710611:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790919529.710704:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710712:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710719:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710724:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.710728:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710735:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710758:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919529.710760:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.710766:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710772:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913b45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710783:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710788:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710794:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710799:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919529.710801:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710807:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710813:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81f00) 00010000:00010000:0.0:1790919529.710816:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919529.710819:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710824:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710888:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c9b expref: 23 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710901:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c9b expref: 22 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.710908:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.710911:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919529.710913:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015c00, rc 0) 00000100:00100000:0.0:1790919529.710982:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11382:x1877914958210304:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 934us (1284us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1790919529.710990:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1790919529.717524:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919529.717566:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.717650:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958210432 00000100:00100000:0.0:1790919529.717662:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958210432 00000100:00100000:2.0:1790919529.717680:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958210560 00000100:00100000:2.0:1790919529.717687:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958210560 00000100:00100000:2.0:1790919529.717734:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:0.0:1790919529.717735:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790919529.717749:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11382:x1877914958210560:12345-192.168.203.11@tcp:54:lfs.0 00000100:00100000:0.0:1790919529.717750:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:2413:x1877914958210432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919529.717770:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919529.717795:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c9b expref: 23 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717814:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.717817:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.717825:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919529.717836:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717850:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717878:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717888:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717896:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919529.717897:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:2413:x1877914958210432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 149us (381us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919529.717913:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00000100:00100000:0.0:1790919529.717916:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00010000:00010000:2.0:1790919529.717919:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717928:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717939:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919529.717957:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919529.717963:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.717969:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919529.718010:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11382:x1877914958210560:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 265us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919529.718018:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1790919529.723384:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.723484:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958210816 00000100:00100000:2.0:1790919529.723494:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958210816 00000100:00100000:2.0:1790919529.723550:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919529.723560:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11382:x1877914958210816:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919529.723818:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11382:x1877914958210816:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 259us (443us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790919529.723826:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00010000:00010000:1.0:1790919529.884489:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919529.884689:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978211712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919529.884706:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919529.884718:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978211840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919529.886796:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919529.886946:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978211840 00000100:00100000:1.0:1790919529.886956:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978211840 00000100:00100000:1.0:1790919529.887026:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790919529.887037:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978211840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919529.887093:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919529.887151:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978211840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919529.887158:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1790919529.887297:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919529.887377:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978211840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919529.892999:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919529.893294:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978211712 00000100:00100000:1.0:1790919529.893303:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978211712 00000100:00100000:1.0:1790919529.893422:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790919529.893431:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978211712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919529.893464:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919529.893539:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978211712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919529.893546:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919529.893637:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978211712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790919529.893955:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919529.923411:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.923528:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958211072 00000100:00100000:0.0:1790919529.923538:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958211072 00000100:00100000:0.0:1790919529.923648:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:0.0:1790919529.923659:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11400:x1877914958211072:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1790919529.923693:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919529.923714:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ca2 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.923814:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b6f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.923841:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.923853:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.923864:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790919529.924188:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ca2 expref: 25 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.924207:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ca2 expref: 24 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.924215:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919529.924218:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790919529.924222:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015a00, rc 0) 00000100:00100000:0.0:1790919529.924289:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11400:x1877914958211072:12345-192.168.203.11@tcp:101:cat.0 Request processed in 632us (889us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1790919529.924309:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:1.0:1790919529.963432:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919529.963547:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958211200 00000100:00100000:0.0:1790919529.963557:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958211200 00000100:00100000:0.0:1790919529.963620:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:0.0:1790919529.963631:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11401:x1877914958211200:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919529.963662:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919529.963683:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ca9 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.963767:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.963782:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.963793:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919529.963827:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790919529.963831:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919529.963860:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.963885:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913b7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ca9 expref: 26 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.963903:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ca9 expref: 25 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919529.963929:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919529.963932:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919529.963936:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014e00, rc 0) 00000100:00100000:0.0:1790919529.964005:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11401:x1877914958211200:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 375us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919529.964021:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1790919529.968762:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.968995:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958211584 00000100:00100000:2.0:1790919529.969004:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958211584 00000100:00100000:2.0:1790919529.969096:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790919529.969107:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11401:x1877914958211584:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919529.969697:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:11401:x1877914958211584:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 589us (941us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1790919529.970656:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790919529.977386:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.977552:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958211712 00000100:00100000:2.0:1790919529.977563:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958211712 00000100:00100000:2.0:1790919529.977629:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1790919529.977639:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:11401:x1877914958211712:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:2.0:1790919529.977654:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790919529.977680:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913b14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c8d expref: 26 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.977969:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913b6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ca2 expref: 25 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.977988:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913a18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c4e expref: 24 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.977999:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919529.978004:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919529.978154:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11401:x1877914958211712:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 516us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919529.978162:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919529.988395:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919529.990802:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958211840 00000100:00100000:2.0:1790919529.990815:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958211840 00000100:00100000:3.0:1790919529.991585:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:3.0:1790919529.991614:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11401:x1877914958211840:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:2.0:1790919529.992196:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.992215:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919529.992234:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919529.993394:0:6445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919529.993713:0:6445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790919529.993796:0:6445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790919529.994243:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11401:x1877914958211840:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 2628us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919529.994255:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:1.0:1790919530.026295:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.026788:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958211968 00000100:00100000:3.0:1790919530.026799:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958211968 00000100:00100000:3.0:1790919530.026912:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1790919530.026922:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11403:x1877914958211968:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919530.026942:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919530.026961:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913b92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cb0 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027034:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027048:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027096:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027111:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027117:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027124:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027415:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027424:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027438:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919530.027481:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790919530.027485:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919530.027502:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027523:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.027994:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028001:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028087:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028094:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.028098:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028106:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028118:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919530.028121:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919530.028125:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028235:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913b99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028250:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028256:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028262:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028266:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.028269:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028274:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028282:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f3904a5100) 00010000:00010000:3.0:1790919530.028285:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919530.028287:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028292:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913ba0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028328:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913b92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 25 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028342:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 24 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.028356:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919530.028358:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919530.028360:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:2.0:1790919530.028833:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11403:x1877914958211968:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1909us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.028842:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000040:00080000:2.0:1790919530.204226:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919530.204235:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919530.204293:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790919530.204303:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919530.204922:0:13302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978211968:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919530.205540:0:13302:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3920e3840 going to sleep for 11 seconds 00000040:00080000:3.0:1790919530.207164:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790919530.210146:0:13302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978211968:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790919530.213014:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.213223:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958212096 00000100:00100000:0.0:1790919530.213234:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958212096 00000100:00100000:0.0:1790919530.213294:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1790919530.213304:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11414:x1877914958212096:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919530.214457:0:6447:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919530.214590:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11414:x1877914958212096:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 1284us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919530.214600:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1790919530.226341:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.227834:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958212224 00000100:00100000:2.0:1790919530.227860:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958212224 00000100:00100000:2.0:1790919530.228044:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1790919530.228073:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11414:x1877914958212224:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790919530.228150:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228167:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228180:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228247:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228256:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228264:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228289:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228297:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228304:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919530.228347:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790919530.228352:0:13325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919530.228367:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228377:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228384:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228391:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228407:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919530.228412:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228419:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228432:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919530.228435:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919530.228440:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228446:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913bae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228459:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228465:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228480:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228485:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919530.228488:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228493:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228512:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff95f3930c1c00) 00010000:00010000:2.0:1790919530.228515:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919530.228637:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228646:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913bb5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228662:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228667:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228673:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228678:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919530.228681:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228686:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228695:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919530.228698:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919530.228701:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.228706:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.228804:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11414:x1877914958212224:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 750us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.228812:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:1.0:1790919530.232117:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.232252:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958212480 00000100:00100000:3.0:1790919530.232261:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958212480 00000100:00100000:3.0:1790919530.232323:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1790919530.232441:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11414:x1877914958212480:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919530.232464:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919530.232492:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913bc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cb7 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232606:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232621:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232631:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919530.232642:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790919530.232742:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232750:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232756:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232768:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.232773:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232782:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232794:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919530.232797:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919530.232802:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232808:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913bca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232849:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913bc3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb7 expref: 26 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232859:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919530.232861:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919530.232864:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913bc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb7 expref: 26 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.232872:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00100000:3.0:1790919530.232925:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11414:x1877914958212480:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 594us (817us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1790919530.232933:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1790919530.239830:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.241087:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958212608 00000100:00100000:2.0:1790919530.241098:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958212608 00000100:00100000:2.0:1790919530.241168:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1790919530.241179:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11414:x1877914958212608:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790919530.241214:0:10757:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790919530.241324:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11414:x1877914958212608:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 147us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.241344:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:1.0:1790919530.246650:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.247359:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958212864 00000100:00100000:0.0:1790919530.247370:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958212864 00000100:00100000:0.0:1790919530.247427:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1790919530.247437:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11414:x1877914958212864:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919530.247462:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919530.247465:0:13325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790919530.247502:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913b84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ca9 expref: 25 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.247529:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919530.247534:0:13325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919530.247555:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bd8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cbe expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790919530.248325:0:13325:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790919530.248587:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913bdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.248603:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.248613:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.248674:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bd8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cbe expref: 27 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.248690:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cbe expref: 26 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.248698:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919530.248701:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919530.248704:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919530.248778:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:11414:x1877914958212864:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1342us (2133us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1790919530.248786:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:3.0:1790919530.262691:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.262763:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958213120 00000100:00100000:0.0:1790919530.262773:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958213120 00000100:00100000:0.0:1790919530.262830:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1790919530.262840:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:11414:x1877914958213120:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919530.262908:0:7785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919530.262935:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913bdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cbe expref: 26 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.262949:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919530.262959:0:7785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919530.262980:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.262993:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263003:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263015:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263021:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263027:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263268:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263277:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263283:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263294:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919530.263298:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263306:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263315:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919530.263318:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919530.263322:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263327:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913bed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263336:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263341:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263346:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263351:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919530.263353:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263359:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263376:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8fb8fdca (ffff95f382b81400) 00010000:00010000:0.0:1790919530.263379:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919530.263382:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.263389:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913bf4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8fb8fdca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919530.263464:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11414:x1877914958213120:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 624us (781us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919530.263482:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1790919530.272583:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.272631:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958213248 00000100:00100000:2.0:1790919530.272643:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958213248 00000100:00100000:2.0:1790919530.272701:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:2.0:1790919530.272712:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11414:x1877914958213248:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919530.272734:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919530.272758:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cc5 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.272795:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.272810:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.272822:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.272938:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913bfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 27 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.273508:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 26 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.273701:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:2.0:1790919530.273704:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919530.273707:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919530.274014:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:11414:x1877914958213248:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1302us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.274022:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:3.0:1790919530.282221:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.284681:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958213504 00000100:00100000:0.0:1790919530.284695:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958213504 00000100:00100000:0.0:1790919530.284750:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1790919530.284759:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:11414:x1877914958213504:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919530.284839:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.284854:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.284866:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919530.285850:0:13325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1790919530.285864:0:13325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339313810728ns, next at 340313808226ns, rc = 0 00000004:00010000:1.0:1790919530.285942:0:13325:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008456f360 reply state 000000000fd0a4e7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.285957:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.285966:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:1.0:1790919530.285969:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790919530.285973:0:13325:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919530.286109:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:11414:x1877914958213504:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1348us (3896us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1790919530.286118:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:1.0:1790919530.287901:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.287997:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958213632 00000100:00100000:0.0:1790919530.288016:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958213632 00000100:00100000:0.0:1790919530.288086:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:0.0:1790919530.288097:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:11414:x1877914958213632:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919530.288137:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919530.288157:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ccc expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.288549:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 29 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.288563:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 29 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.288580:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:0.0:1790919530.288583:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919530.288586:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919530.289384:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11414:x1877914958213632:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1285us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919530.289394:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:0.0:1790919530.297532:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.297713:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958213760 00000100:00100000:3.0:1790919530.297724:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958213760 00000100:00100000:3.0:1790919530.297799:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790919530.297808:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958213760:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1790919530.297840:0:8248:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1790919530.297871:0:8248:0:(genops.c:1384:class_connect()) connect: client fd078e75-25ee-44fe-89dc-39e9cfa5e4b5, cookie 0x951c50ad15913c17 00002000:00100000:3.0:1790919530.297881:0:8248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fd078e75-25ee-44fe-89dc-39e9cfa5e4b5/ffff95f3b4713000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790919530.297891:0:8248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790919530.298168:0:8248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790919530.298198:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f398dcc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919530.298255:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2410:x1877914958213760:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 Request processed in 447us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919530.298262:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1790919530.308767:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.308876:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958213888 00000100:00100000:3.0:1790919530.308886:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958213888 00000100:00080000:0.0:1790919530.308956:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919530.309491:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1790919530.309504:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:0:x1877914958213888:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790919530.401366:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:0:x1877914958213888:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 91855us (92599us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790919530.401380:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000001:00080000:2.0:1790919530.401424:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1790919530.401436:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000100:00100000:1.0:1790919530.404931:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.405028:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958214144 00000100:00100000:0.0:1790919530.405039:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958214144 00000100:00100000:0.0:1790919530.405217:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790919530.405235:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11414:x1877914958214144:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790919530.405482:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:11414:x1877914958214144:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 255us (614us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1790919530.405505:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1790919530.411541:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.411620:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958214400 00000100:00100000:0.0:1790919530.411631:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958214400 00000100:00100000:0.0:1790919530.411695:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:0.0:1790919530.411705:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:11414:x1877914958214400:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790919530.411822:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:11414:x1877914958214400:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919530.411830:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1790919530.414701:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.414788:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958214528 00000100:00100000:3.0:1790919530.414798:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958214528 00000100:00100000:3.0:1790919530.414853:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1790919530.414869:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:11414:x1877914958214528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919530.414889:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919530.414909:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913c1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cd3 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.414979:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913c25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.415006:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.415017:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919530.415069:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919530.415086:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.415110:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913c1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cd3 expref: 32 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.415125:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913c25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cd3 expref: 31 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.415133:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:3.0:1790919530.415136:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790919530.415139:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00100000:3.0:1790919530.415196:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11414:x1877914958214528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 336us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919530.415203:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1790919530.422764:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.422850:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958214656 00000100:00100000:0.0:1790919530.422861:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958214656 00000100:00100000:0.0:1790919530.422917:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1790919530.422929:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958214656:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919530.422948:0:8084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919530.422969:0:8084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cda expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919530.422997:0:8084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf436a, blocks: 0x1 00010000:00010000:0.0:1790919530.423025:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1790919530.423030:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919530.423040:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 6 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.423122:0:8084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 6 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.423151:0:8084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015600, rc 0) 00000100:00100000:0.0:1790919530.423212:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958214656:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 284us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919530.423221:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790919530.435658:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.435750:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958214912 00000100:00100000:3.0:1790919530.435760:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958214912 00000100:00100000:3.0:1790919530.435819:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:3.0:1790919530.435829:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11414:x1877914958214912:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919530.435955:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11414:x1877914958214912:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919530.435973:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:1.0:1790919530.439712:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.439776:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215040 00000100:00100000:3.0:1790919530.439788:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215040 00000100:00100000:3.0:1790919530.439858:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:3.0:1790919530.439877:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:11414:x1877914958215040:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919530.439896:0:8083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919530.439918:0:8083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ce1 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.439946:0:8083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 7 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.439955:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919530.439959:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919530.439964:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 7 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.439998:0:8083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 7 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.440011:0:8083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 7 pid: 8084 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.440026:0:8083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8083:1877914978212096:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919530.440121:0:8083:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919530.448616:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919530.448663:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215168 00000100:00100000:1.0:1790919530.448672:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215168 00010000:00010000:1.0:1790919530.448715:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 8 pid: 8084 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919530.448766:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:1.0:1790919530.448776:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958215168:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919530.448791:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919530.448813:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 8 pid: 8084 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.448827:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 8 pid: 8084 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.448850:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919530.448854:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919530.448862:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.448878:0:6432:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.448914:0:6432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919530.448929:0:6432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286810a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6432:1877914978212224:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790919530.449006:0:6432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6e40 going to sleep for 11 seconds 00010000:00010000:3.0:1790919530.452199:0:8083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000274b930/0x951c50ad15913c2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cda expref: 8 pid: 8084 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.452221:0:8083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8083:1877914978212096:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919530.452251:0:8083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 7 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.452265:0:8083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ca00, rc 0) 00000100:00100000:3.0:1790919530.452379:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:11414:x1877914958215040:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 12511us (12674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919530.452386:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:3.0:1790919530.455454:0:6432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286810a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6432:1877914978212224:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790919530.455489:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919530.455571:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958215168:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6795us (6964us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919530.455582:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1790919530.460602:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.461104:0:8090:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215296 00000100:00100000:2.0:1790919530.461114:0:8090:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215296 00002000:00100000:2.0:1790919530.461157:0:8090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff95f3ae849180 x1877914958215296/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:651/0 lens 504/0 e 0 to 0 dl 1790919541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919530.461167:0:8090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f3ae849180 with x1877914958215296 ext(0->8) 00002000:00010000:2.0:1790919530.461172:0:8090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f3ae849180 00000100:00100000:2.0:1790919530.461196:0:8090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790919530.461210:0:8090:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958215296:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790919530.461843:0:8090:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958215296:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 631us (1248us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790919530.461851:0:8090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:2.0:1790919530.461859:0:8090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff95f3ae849180 x1877914958215296/t4294967303(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:651/0 lens 504/448 e 0 to 0 dl 1790919541 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919530.461867:0:8090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f3ae849180 with x1877914958215296 ext(0->8) 00002000:00010000:2.0:1790919530.461871:0:8090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f3ae849180 00000100:00100000:0.0:1790919530.475326:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919530.475362:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215424 00000100:00100000:0.0:1790919530.475371:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215424 00000100:00100000:0.0:1790919530.475421:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:0.0:1790919530.475431:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11414:x1877914958215424:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1790919530.521688:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11414:x1877914958215424:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 46248us (46357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.521702:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000001:00080000:2.0:1790919530.521753:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1790919530.521764:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790919530.521815:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1790919530.522016:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1790919530.522025:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790919530.522039:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978212352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790919530.522103:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919530.522144:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.522150:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978212352 00010000:00010000:0.0:1790919530.522156:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.522157:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978212352 00010000:00010000:0.0:1790919530.522163:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522170:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919530.522175:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522182:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.522191:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1790919530.522196:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00000100:00100000:2.0:1790919530.522198:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978212352:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790919530.522206:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919530.522211:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522217:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913b06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522242:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522249:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522255:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522259:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919530.522262:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522267:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522275:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:0.0:1790919530.522277:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790919530.522279:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.522284:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913c09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919530.522342:0:8084:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790919530.522346:0:8084:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790919531 00002000:00010000:2.0:1790919530.522348:0:8084:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790919530.522357:0:8084:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790919530 -> 1790919531 00002000:00010000:2.0:1790919530.522359:0:8084:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790919530.522767:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978212352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 568us (662us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790919530.522776:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1790919530.523277:0:3459:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f3b658f480/2, rc 0, transno 4294967304 00000100:00100000:0.0:1790919530.523285:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b658f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978212352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790919530.523998:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.524203:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215552 00000100:00100000:3.0:1790919530.524211:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215552 00000100:00100000:3.0:1790919530.524331:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:3.0:1790919530.524341:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2411:x1877914958215552:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790919530.573230:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1790919530.573249:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1790919530.573416:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958215552:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 49071us (49417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919530.573440:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790919530.575939:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.576024:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215808 00000100:00100000:3.0:1790919530.576034:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215808 00000100:00100000:3.0:1790919530.576358:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1790919530.576370:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11414:x1877914958215808:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919530.576428:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919530.576476:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913c25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cd3 expref: 13 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.576493:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:3.0:1790919530.576497:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919530.576527:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.576542:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.576552:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919530.576805:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008e0b6b4b reply state 00000000d6da7742 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.576818:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.576824:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:3.0:1790919530.576827:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919530.576830:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919530.576925:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bdf0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:11414:x1877914958215808:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 556us (993us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1790919530.576932:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:0.0:1790919530.579935:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.580042:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958215936 00000100:00100000:2.0:1790919530.580168:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958215936 00000100:00100000:2.0:1790919530.580252:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790919530.580262:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958215936:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790919530.580510:0:8084:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790919530.580514:0:8084:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790919531 -> 1790919530 00002000:00010000:2.0:1790919530.580516:0:8084:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790919529 00002000:00010000:2.0:1790919530.580519:0:8084:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790919531 -> 1790919530 00002000:00010000:2.0:1790919530.580521:0:8084:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790919530.580582:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958215936:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 321us (656us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790919530.580590:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790919530.582336:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.582405:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958216192 00000100:00100000:2.0:1790919530.582412:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958216192 00000100:00100000:2.0:1790919530.582464:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:2.0:1790919530.582485:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:11414:x1877914958216192:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790919530.582550:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.582583:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 14 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.582593:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.582628:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 14 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.582642:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 14 pid: 10757 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.582655:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978212480:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919530.582735:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919530.585022:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919530.585135:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958216320 00000100:00100000:1.0:1790919530.585144:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958216320 00010000:00010000:1.0:1790919530.585182:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 15 pid: 10757 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919530.585220:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1790919530.585229:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:2414:x1877914958216320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919530.585242:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919530.585249:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 15 pid: 10757 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.585260:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 15 pid: 10757 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.585282:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:1.0:1790919530.585288:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.585297:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.585304:0:13233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.585323:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919530.585379:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:2414:x1877914958216320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 151us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919530.585404:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00010000:00010000:2.0:1790919530.586339:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cc5 expref: 14 pid: 10757 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.586361:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978212480:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919530.586383:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586392:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586398:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586427:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586445:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586452:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586458:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919530.586462:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586478:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586490:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:2.0:1790919530.586493:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790919530.586497:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.586503:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.586671:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11414:x1877914958216192:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 4187us (4340us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790919530.586681:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:0.0:1790919530.589568:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.589665:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958216448 00000100:00100000:3.0:1790919530.589674:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958216448 00000100:00100000:3.0:1790919530.589728:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1790919530.589738:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2412:x1877914958216448:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790919530.589798:0:8083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.589818:0:8083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 7 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.589827:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919530.589832:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919530.589837:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.589880:0:8083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 7 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.589894:0:8083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 7 pid: 8083 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.589917:0:8083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8083:1877914978212608:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919530.590201:0:8083:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919530.592823:0:8083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8083:1877914978212608:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919530.592852:0:8083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919530.594434:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919530.594758:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958216576 00000100:00100000:1.0:1790919530.594766:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958216576 00010000:00010000:1.0:1790919530.594805:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919530.594847:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790919530.594856:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958216576:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919530.594879:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919530.594901:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.594924:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.594948:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913c33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce1 expref: 8 pid: 8083 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.594964:0:6431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919530.594968:0:6431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919530.594974:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.594985:0:6431:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.595038:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919530.595143:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958216576:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 287us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919530.595151:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00010000:00010000:3.0:1790919530.595335:0:8083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595358:0:8083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595382:0:8083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595391:0:8083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595401:0:8083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595408:0:8083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ce00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919530.595413:0:8083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595421:0:8083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595436:0:8083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.595444:0:8083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913c48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.595530:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958216448:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 5793us (6028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919530.595538:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919530.599175:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.599293:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958216832 00000100:00100000:2.0:1790919530.599303:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958216832 00000100:00100000:2.0:1790919530.599360:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:2.0:1790919530.599370:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11414:x1877914958216832:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790919530.599449:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599491:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599503:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599727:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599739:0:10757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 14 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599749:0:10757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599784:0:10757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 14 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.599798:0:10757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 14 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.599814:0:10757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978212736:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919530.600010:0:10757:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854840 going to sleep for 11 seconds 00000100:00100000:2.0:1790919530.618463:0:10757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978212736:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919530.618505:0:10757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919530.619127:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919530.619207:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958216960 00000100:00100000:2.0:1790919530.619229:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958216960 00010000:00010000:2.0:1790919530.619270:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 15 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919530.619311:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1790919530.619320:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:2414:x1877914958216960:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919530.619334:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919530.619341:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 15 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.619353:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 15 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.619373:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ccc expref: 15 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.619389:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:2.0:1790919530.619393:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.619403:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.619411:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919530.619439:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919530.619502:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:2414:x1877914958216960:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 183us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.619519:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00010000:00010000:0.0:1790919530.619877:0:10757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919530.619886:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919530.620038:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1790919530.620211:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1790919530.620257:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1790919530.620331:0:10757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10757:1877914978212864:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1790919530.620380:0:10757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919530.620407:0:10757:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2873356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919530.620487:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978212864 00000100:00100000:2.0:1790919530.620493:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978212864 00000100:00100000:2.0:1790919530.620533:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790919530.620541:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10757:x1877914978212864:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790919530.620619:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10757:x1877914978212864:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919530.620627:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790919530.620702:0:10757:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1790919530.620708:0:10757:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f3b658f480, transno 4294967304 00000100:00100000:3.0:1790919530.620726:0:10757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10757:1877914978212864:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1790919530.621250:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1790919530.621309:0:10757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381327480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10757:1877914978212992:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1790919530.621346:0:10757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919530.621372:0:10757:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919530.621390:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978212992 00000100:00100000:3.0:1790919530.621394:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978212992 00000100:00100000:3.0:1790919530.621421:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790919530.621429:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10757:x1877914978212992:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1790919530.621603:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10757:x1877914978212992:12345-0@lo:1000:mdt00_004.0 Request processed in 174us (256us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790919530.621610:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790919530.621649:0:10757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381327480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10757:1877914978212992:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1790919530.621677:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621687:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621694:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621709:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.621714:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621721:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621736:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:3.0:1790919530.621739:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919530.621743:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621750:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913c56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621780:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621787:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621793:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621798:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.621801:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621806:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621825:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919530.621828:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919530.621831:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621837:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913b8b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621860:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621874:0:10757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 17 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621883:0:10757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621907:0:10757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 17 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.621920:0:10757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 17 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.621931:0:10757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381325180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978213120:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919530.621982:0:10757:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919530.628801:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919530.628836:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958217088 00000100:00100000:1.0:1790919530.628845:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958217088 00010000:00010000:1.0:1790919530.628882:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 18 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919530.628918:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1790919530.628928:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2413:x1877914958217088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919530.628942:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919530.628950:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 18 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.628966:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 18 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.628992:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:1.0:1790919530.628998:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.629009:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.629018:0:13233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.629095:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919530.629161:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2413:x1877914958217088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 232us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919530.629170:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00010000:00010000:3.0:1790919530.629954:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ba7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cb0 expref: 17 pid: 7785 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.629973:0:10757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381325180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978213120:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919530.630004:0:10757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630012:0:10757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630017:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630029:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630035:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630041:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630046:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.630081:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630090:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630103:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919530.630106:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919530.630110:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630116:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c5d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630138:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630143:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630148:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630153:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919530.630155:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630161:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630168:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919530.630171:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919530.630173:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.630179:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913c4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919530.630443:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:11414:x1877914958216832:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 31073us (31277us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1790919530.630455:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000020:00080000:3.0:1790919530.630460:0:10757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790919530.630649:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919530.630654:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919530.630683:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790919530.630692:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790919530.638046:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919530.638144:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958217344 00000100:00100000:3.0:1790919530.638153:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958217344 00000100:00100000:3.0:1790919530.638220:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1790919530.638229:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:11414:x1877914958217344:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790919530.638871:0:6448:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790919530.638971:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1790919530.639013:0:6448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.639031:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.639042:0:6448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.639081:0:6448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.639089:0:6448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.639097:0:6448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919530.639114:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790919530.639198:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:11414:x1877914958217344:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 968us (1158us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1790919530.639207:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000020:00080000:3.0:1790919530.639212:0:6448:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790919530.639374:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919530.639381:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.639390:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919530.639394:0:6433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.639403:0:6433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.639416:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:1.0:1790919530.639419:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790919530.639424:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.639430:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913c64 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.639443:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919530.639445:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919530.639447:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919530.788749:0:13725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919530.788760:0:13725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919530.788798:0:13725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790919530.788806:0:13725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790919530.908298:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919530.930728:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919530.930980:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958217600 00000100:00100000:1.0:1790919530.930991:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958217600 00000100:00100000:1.0:1790919530.931071:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:1.0:1790919530.931088:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:11424:x1877914958217600:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919530.931113:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919530.931132:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913c6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ce8 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.931223:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913c72 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.931238:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913c72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.931250:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913c72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919530.931260:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790919530.931375:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913c6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce8 expref: 21 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.931391:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913c72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce8 expref: 20 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.931400:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919530.931403:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919530.931406:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1ca00, rc 0) 00000100:00100000:1.0:1790919530.931462:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11424:x1877914958217600:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 376us (747us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1790919530.931501:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:0.0:1790919530.939537:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919530.942704:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958217728 00000100:00100000:1.0:1790919530.942717:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958217728 00000100:00100000:1.0:1790919530.942798:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1790919530.942809:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11424:x1877914958217728:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1790919530.942883:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.942901:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.942911:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.942925:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.942932:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.942938:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943168:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943177:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943184:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919530.943221:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943232:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943244:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943251:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943256:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919530.943261:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943268:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943280:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919530.943283:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919530.943287:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943294:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913c80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943305:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943312:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943318:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943323:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919530.943332:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943339:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943347:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f392142300) 00010000:00010000:1.0:1790919530.943350:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919530.943353:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943359:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913c87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943374:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943380:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943387:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943392:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919530.943395:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943400:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943407:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f392142000) 00010000:00010000:1.0:1790919530.943409:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919530.943417:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919530.943424:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913c8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919530.943514:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11424:x1877914958217728:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 706us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919530.943522:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1790919531.028225:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919531.028332:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958217984 00000100:00100000:0.0:1790919531.028342:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958217984 00000100:00100000:0.0:1790919531.028411:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:0.0:1790919531.028420:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:11427:x1877914958217984:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919531.028439:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919531.028461:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cef expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.028776:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.028868:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.028897:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.028922:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.028931:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.028937:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029228:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029238:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029244:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919531.029254:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790919531.029351:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029358:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029366:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029372:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.029382:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029391:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029402:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919531.029405:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.029409:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029415:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913c9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029426:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029432:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029437:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029442:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.029445:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029450:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029457:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f3904a5d00) 00010000:00010000:3.0:1790919531.029459:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.029479:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029485:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913ca3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029530:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913c95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 23 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029544:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 22 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.029550:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:3.0:1790919531.029552:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919531.029554:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00080000:2.0:1790919531.029979:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919531.030101:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11427:x1877914958217984:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1679us (1883us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1790919531.030110:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:1.0:1790919531.038181:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.038278:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958218112 00000100:00100000:2.0:1790919531.038289:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958218112 00000100:00100000:2.0:1790919531.038351:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:2.0:1790919531.038361:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11427:x1877914958218112:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790919531.038429:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038447:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038459:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038498:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038506:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038534:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038540:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919531.038544:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038552:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038563:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:2.0:1790919531.038566:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919531.038571:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.038577:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913cb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.038673:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11427:x1877914958218112:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 313us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.038680:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:0.0:1790919531.044780:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.049097:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958218368 00000100:00100000:3.0:1790919531.049114:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958218368 00000100:00100000:3.0:1790919531.049197:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790919531.049209:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11427:x1877914958218368:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790919531.049494:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11427:x1877914958218368:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 286us (4725us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1790919531.049502:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790919531.092802:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.092906:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958218624 00000100:00100000:3.0:1790919531.092916:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958218624 00000100:00100000:3.0:1790919531.092977:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:3.0:1790919531.092987:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:10955:x1877914958218624:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919531.093028:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919531.093048:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913cbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cf6 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.093180:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.093197:0:6446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 24 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.093206:0:6446:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.093239:0:6446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 24 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.093252:0:6446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 24 pid: 6447 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919531.093266:0:6446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381325180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6446:1877914978213248:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919531.093358:0:6446:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00780 going to sleep for 11 seconds 00000100:00100000:3.0:1790919531.103785:0:6446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381325180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6446:1877914978213248:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919531.104025:0:6446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.104724:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.106017:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958218752 00000100:00100000:2.0:1790919531.106029:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958218752 00010000:00010000:2.0:1790919531.106119:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 25 pid: 6447 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.106164:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1790919531.106175:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:2414:x1877914958218752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919531.106191:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919531.106214:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 25 pid: 6447 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.106228:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 25 pid: 6447 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.106251:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913caa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cef expref: 25 pid: 6447 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.106268:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:2.0:1790919531.106273:0:6431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.106332:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.106340:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.106363:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919531.106412:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:2414:x1877914958218752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 239us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.106419:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00010000:00010000:3.0:1790919531.111089:0:6446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.111107:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919531.111219:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790919531.111655:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913cbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 25 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.111676:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 24 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.111686:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:1.0:1790919531.111688:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919531.111691:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c800, rc 0) 00000100:00100000:1.0:1790919531.111747:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:10955:x1877914958218624:12345-192.168.203.11@tcp:101:bash.0 Request processed in 18762us (18968us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1790919531.111756:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:2.0:1790919531.116540:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.116956:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219008 00000100:00100000:3.0:1790919531.116966:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219008 00000100:00100000:3.0:1790919531.117024:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:3.0:1790919531.117033:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:10955:x1877914958219008:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1790919531.117331:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.117348:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.117359:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919531.117404:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1790919531.117424:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ad0820f reply state 00000000f52025b1 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.117435:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.117443:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:3.0:1790919531.117445:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919531.117449:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790919531.117498:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1790919531.117601:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:10955:x1877914958219008:12345-192.168.203.11@tcp:36:bash.0 Request processed in 567us (1070us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1790919531.117609:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000020:00080000:3.0:1790919531.117615:0:10757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790919531.121782:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.121884:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219136 00000100:00100000:2.0:1790919531.121894:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219136 00000100:00100000:2.0:1790919531.121949:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:2.0:1790919531.121959:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:10955:x1877914958219136:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919531.121984:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919531.122017:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913cdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38cfd expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.122113:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913cdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cfd expref: 29 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.122128:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913cdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cfd expref: 29 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.122147:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:2.0:1790919531.122150:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919531.122153:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696200, rc 0) 00000100:00100000:2.0:1790919531.122219:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:10955:x1877914958219136:12345-192.168.203.11@tcp:101:bash.0 Request processed in 261us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.122225:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:1.0:1790919531.126906:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.127096:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219264 00000100:00100000:3.0:1790919531.127106:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219264 00000100:00100000:3.0:1790919531.127165:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:3.0:1790919531.127174:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:10955:x1877914958219264:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919531.127191:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919531.127211:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d04 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919531.127235:0:8248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abf436a, atime: 0x6abf4369, ctime: 0x6abf436a, blocks: 0xb 00010000:00010000:3.0:1790919531.127254:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1790919531.127259:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919531.127266:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.127292:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.127304:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166de00, rc 0) 00000100:00100000:3.0:1790919531.127356:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:10955:x1877914958219264:12345-192.168.203.11@tcp:101:bash.0 Request processed in 184us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919531.127363:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1790919531.131390:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.131544:0:8088:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219392 00000100:00100000:2.0:1790919531.131554:0:8088:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219392 00002000:00010000:2.0:1790919531.131595:0:8088:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1790919531.131600:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f3b5eedc00 with x1877914958219392 ext(0->18446744073709551615) 00002000:00010000:2.0:1790919531.131611:0:8088:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f3b5eedc00. 00000100:00100000:2.0:1790919531.131643:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790919531.131652:0:8088:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958219392:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:2.0:1790919531.132666:0:8088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790919531.132673:0:8088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790919530 -> 1790919531 00002000:00010000:2.0:1790919531.132676:0:8088:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1790919529 -> 1790919529 00002000:00010000:2.0:1790919531.132678:0:8088:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790919530 -> 1790919531 00002000:00010000:2.0:1790919531.132680:0:8088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790919531.132759:0:8088:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958219392:12345-192.168.203.11@tcp:10:bash.0 Request processed in 1106us (1376us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790919531.132768:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00010000:2.0:1790919531.132773:0:8088:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1790919531.132776:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f3b5eedc00 with x1877914958219392 ext(0->18446744073709551615) 00002000:00010000:2.0:1790919531.132782:0:8088:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f3b5eedc00. 00000100:00100000:1.0:1790919531.239591:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919531.240157:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219520 00000100:00100000:0.0:1790919531.240169:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219520 00000100:00100000:0.0:1790919531.240223:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:0.0:1790919531.240233:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11441:x1877914958219520:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790919531.240310:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240330:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240342:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240356:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240362:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240368:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240597:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240606:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240612:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919531.240655:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240668:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240675:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240683:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240689:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919531.240693:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240700:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240710:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919531.240713:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919531.240717:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240728:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913ce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240740:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240745:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240750:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240755:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919531.240758:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240763:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240773:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:0.0:1790919531.240775:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919531.240777:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240782:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913cf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240802:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240808:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240818:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240822:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919531.240825:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240831:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240837:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:0.0:1790919531.240839:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919531.240841:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.240845:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913cf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919531.240938:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11441:x1877914958219520:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 705us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919531.240946:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:1.0:1790919531.295038:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.295134:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219776 00000100:00100000:3.0:1790919531.295143:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219776 00000100:00100000:3.0:1790919531.295193:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1790919531.295201:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:11444:x1877914958219776:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919531.295222:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919531.295256:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913cfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d0b expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295326:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295341:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295352:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295367:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295373:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295379:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295637:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913d13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295646:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913d13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295654:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913d13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919531.295663:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790919531.295760:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295777:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295784:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295790:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.295794:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295801:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295814:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919531.295817:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.295822:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295829:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913d05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295839:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295846:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295852:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295858:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.295866:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295872:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295880:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f3904a5500) 00010000:00010000:3.0:1790919531.295883:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.295885:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295891:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913d0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295932:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913cfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d0b expref: 32 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295946:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913d13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d0b expref: 31 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.295953:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:3.0:1790919531.295955:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790919531.295958:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d400, rc 0) 00000100:00100000:3.0:1790919531.296028:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11444:x1877914958219776:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 827us (997us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790919531.296034:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:2.0:1790919531.299282:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.299374:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958219904 00000100:00100000:1.0:1790919531.299384:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958219904 00000100:00100000:1.0:1790919531.299440:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:1.0:1790919531.299450:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11444:x1877914958219904:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1790919531.299539:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.299557:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 31 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.299566:0:13325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.299613:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 31 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.299627:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 31 pid: 6446 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.299641:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978213376:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919531.299727:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919531.302976:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978213376:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919531.303007:0:13325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.303939:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.304046:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958220160 00000100:00100000:3.0:1790919531.304074:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958220160 00000100:00100000:3.0:1790919531.304138:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790919531.304147:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:10893:x1877914958220160:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790919531.304477:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+33:10893:x1877914958220160:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 329us (541us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790919531.304486:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1790919531.307955:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.308106:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958220288 00000100:00100000:2.0:1790919531.308116:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958220288 00010000:00010000:2.0:1790919531.308167:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 33 pid: 6446 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.308208:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790919531.308217:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+33:2413:x1877914958220288:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919531.308232:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919531.308238:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 33 pid: 6446 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.308250:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 33 pid: 6446 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.308269:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15913cc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cf6 expref: 33 pid: 6446 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.308298:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:2.0:1790919531.308304:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.308313:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.308321:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.308352:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919531.308416:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:2413:x1877914958220288:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.308423:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00010000:00010000:1.0:1790919531.308609:0:13325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308618:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308658:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308665:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308672:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308678:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919531.308682:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308689:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308698:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:1.0:1790919531.308701:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919531.308705:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.308711:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.308753:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11444:x1877914958219904:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 9305us (9480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.308762:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:2.0:1790919531.311566:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.311768:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958220544 00000100:00100000:3.0:1790919531.311778:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958220544 00000100:00100000:3.0:1790919531.311825:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790919531.311834:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:11444:x1877914958220544:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790919531.312086:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:11444:x1877914958220544:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 252us (528us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790919531.312094:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1790919531.387514:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.387751:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958220800 00000100:00100000:2.0:1790919531.387762:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958220800 00000100:00100000:2.0:1790919531.387829:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:2.0:1790919531.387840:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:11455:x1877914958220800:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1790919531.387867:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919531.387890:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913d28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d12 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.387971:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.387991:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388020:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388034:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388042:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388048:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388320:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913d3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388330:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388337:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919531.388348:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790919531.388443:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388451:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388458:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388474:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919531.388485:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388493:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388504:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919531.388507:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919531.388511:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388518:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388531:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388537:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388543:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388548:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919531.388551:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388557:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388564:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f3930c1d00) 00010000:00010000:2.0:1790919531.388566:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919531.388575:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388581:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388690:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913d28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d12 expref: 35 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388705:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913d3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d12 expref: 34 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.388712:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:2.0:1790919531.388714:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919531.388716:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696000, rc 0) 00000100:00100000:2.0:1790919531.388789:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:11455:x1877914958220800:12345-192.168.203.11@tcp:101:cat.0 Request processed in 951us (1285us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790919531.388797:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:2.0:1790919531.394127:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.394224:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958221056 00000100:00100000:3.0:1790919531.394234:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958221056 00000100:00100000:3.0:1790919531.394290:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1790919531.394300:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:11455:x1877914958221056:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1790919531.394518:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:11455:x1877914958221056:12345-192.168.203.11@tcp:35:cat.0 Request processed in 219us (398us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1790919531.394526:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1790919531.412389:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919531.412507:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958221312 00000100:00100000:0.0:1790919531.412518:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958221312 00000100:00100000:0.0:1790919531.412633:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:0.0:1790919531.412644:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:11456:x1877914958221312:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1790919531.412702:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790919531.412732:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913d3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d12 expref: 35 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412779:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15913d13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d0b expref: 34 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412793:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913cdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38cfd expref: 33 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412804:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:0.0:1790919531.412808:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919531.412829:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412842:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412852:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412879:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412887:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.412894:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.413382:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.413393:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.413409:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919531.414030:0:10757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1790919531.414040:0:10757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340441986667ns, next at 341441984010ns, rc = 0 00010000:00010000:1.0:1790919531.414143:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414155:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414164:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414172:0:10757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414179:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414186:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414205:0:10757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919531.414226:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414232:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414239:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414254:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919531.414259:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414267:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414277:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:1.0:1790919531.414280:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790919531.414284:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414290:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414307:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414313:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414319:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414323:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919531.414326:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414332:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414349:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919531.414351:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919531.414355:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414360:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913d4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919531.414370:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f3312b58 reply state 00000000e509b213 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414379:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.414386:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:1.0:1790919531.414388:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919531.414391:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919531.414484:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:11456:x1877914958221312:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1839us (2102us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790919531.414493:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00010000:00010000:0.0:1790919531.414886:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919531.414894:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.414911:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919531.414915:0:7708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.414921:0:7708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.414940:0:7708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:0.0:1790919531.414943:0:7708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790919531.414946:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.414952:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d60 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.414964:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919531.414966:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919531.414968:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919531.421263:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978213504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919531.421339:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.421391:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919531.421400:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978213632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919531.421431:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.421492:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978213504 00000100:00100000:1.0:1790919531.421500:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978213504 00000100:00100000:1.0:1790919531.421563:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978213632 00000100:00100000:1.0:1790919531.421567:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978213632 00000100:00100000:1.0:1790919531.421616:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790919531.421628:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978213504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919531.421677:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919531.421733:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978213504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.421741:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790919531.421766:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919531.421776:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978213632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919531.421786:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919531.422256:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978213632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 481us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.422265:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919531.422335:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978213632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919531.422361:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978213504:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790919531.422393:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919531.422450:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978213760:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.424436:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.424579:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978213760 00000100:00100000:1.0:1790919531.424589:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978213760 00000100:00100000:1.0:1790919531.424631:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1790919531.424646:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978213760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.424694:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978213760:12345-0@lo:400:kworker.0 Request processed in 51us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.424701:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1790919531.424741:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978213760:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.424798:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978213888:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.425976:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978214272:0@lo:400:kworker.0 00000100:00100000:2.0:1790919531.426163:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978214016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426285:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.426290:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978214144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426323:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978214784:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426328:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.426356:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978214656:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426361:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919531.426390:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790919531.426391:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919531.426398:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978214400:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426437:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214144 00000100:00100000:0.0:1790919531.426443:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.426444:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214144 00000100:00100000:0.0:1790919531.426477:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978214912:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426500:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790919531.426504:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.426521:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978214144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426540:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214272 00000100:00100000:0.0:1790919531.426544:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214272 00000100:00100000:0.0:1790919531.426572:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214400 00000100:00100000:0.0:1790919531.426575:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214400 00000100:00100000:1.0:1790919531.426581:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978214144:12345-0@lo:400:kworker.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.426588:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790919531.426602:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214912 00000100:00100000:0.0:1790919531.426605:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214912 00000100:00100000:1.0:1790919531.426616:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214784 00000100:00100000:1.0:1790919531.426621:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214784 00000100:00100000:0.0:1790919531.426629:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790919531.426638:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978214272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426653:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214656 00000100:00100000:1.0:1790919531.426658:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214656 00000100:00100000:0.0:1790919531.426678:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978214272:12345-0@lo:400:kworker.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.426687:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790919531.426687:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790919531.426699:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978214784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426707:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790919531.426715:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426742:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978214784:12345-0@lo:400:kworker.0 Request processed in 43us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.426749:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790919531.426754:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978214400:12345-0@lo:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919531.426761:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790919531.426765:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790919531.426775:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978214656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426780:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790919531.426789:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426822:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978214912:12345-0@lo:400:kworker.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919531.426831:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790919531.426833:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978214656:12345-0@lo:400:kworker.0 Request processed in 57us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.426851:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790919531.426863:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978214400:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426876:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978214912:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426883:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919531.426890:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978214272:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.426903:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978214784:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426938:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978214144:0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.426950:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978214656:0@lo:400:kworker.0 00000100:00080000:0.0:1790919531.426962:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919531.426968:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919531.426977:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978213888 00000100:00100000:1.0:1790919531.426981:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978213888 00000100:00100000:1.0:1790919531.427351:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790919531.427359:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.427399:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978213888:12345-0@lo:400:kworker.0 Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.427406:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790919531.433843:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919531.433900:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978214528:0@lo:400:kworker.0 00000100:00100000:2.0:1790919531.433934:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919531.433963:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978215040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919531.433985:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919531.434073:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214528 00000100:00100000:1.0:1790919531.434083:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214528 00000100:00100000:1.0:1790919531.434133:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978215040 00000100:00100000:1.0:1790919531.434136:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978215040 00000100:00100000:1.0:1790919531.434152:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790919531.434160:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978214528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.434254:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790919531.434265:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978215040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919531.434364:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978214528:12345-0@lo:400:kworker.0 Request processed in 203us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.434372:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790919531.434425:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978213888:0@lo:400:kworker.0 00000100:00100000:3.0:1790919531.434940:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978214016 00000100:00100000:3.0:1790919531.434947:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978214016 00000100:00100000:3.0:1790919531.434978:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790919531.434986:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978214016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919531.435042:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978214016:12345-0@lo:400:kworker.0 Request processed in 56us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919531.435049:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1790919531.437967:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919531.438698:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978215040:12345-0@lo:400:kworker.0 Request processed in 4430us (4705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919531.438712:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:2.0:1790919531.441246:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2839ac000 x1877914978215040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919531.441264:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978215040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919531.441322:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978214016:0@lo:400:kworker.0 00010000:00080000:2.0:1790919531.441335:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2839ae300 x1877914978214528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919531.441344:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978214528:0@lo:400:kworker.0 00000100:00100000:0.0:1790919531.463653:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.463746:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958221568 00000100:00100000:1.0:1790919531.463757:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958221568 00000100:00100000:1.0:1790919531.463838:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:1.0:1790919531.463849:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:11462:x1877914958221568:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919531.463889:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919531.463910:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d19 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464041:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464092:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464105:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464117:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464125:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464132:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919531.464649:0:6445:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790919531.464847:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464859:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464867:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464911:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464919:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464926:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464931:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919531.464936:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464944:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464955:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919531.464958:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919531.464963:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464970:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913d6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919531.464984:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b96f50c5 reply state 00000000ede0ade5 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.464995:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.465000:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:1.0:1790919531.465008:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919531.465012:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790919531.465041:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15913d67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 37 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.465099:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 36 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.465107:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:1.0:1790919531.465109:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919531.465111:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c200, rc 0) 00000100:00100000:1.0:1790919531.465179:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:11462:x1877914958221568:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1331us (1535us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790919531.465187:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:3.0:1790919531.471444:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.471617:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958221696 00000100:00100000:1.0:1790919531.471628:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958221696 00000100:00100000:1.0:1790919531.471784:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790919531.471794:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958221696:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919531.471812:0:8082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919531.471832:0:8082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d20 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919531.471870:0:8082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790919531.471891:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1790919531.471896:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919531.471905:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 8 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.471945:0:8082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 8 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.471959:0:8082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c800, rc 0) 00000100:00100000:1.0:1790919531.472120:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958221696:12345-192.168.203.11@tcp:101:bash.0 Request processed in 327us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.472128:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00080000:0.0:1790919531.472176:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919531.477097:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.477334:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958221824 00000100:00100000:1.0:1790919531.477345:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958221824 00000100:00100000:1.0:1790919531.477399:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1790919531.477409:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:11462:x1877914958221824:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919531.477427:0:8084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919531.477445:0:8084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d27 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.477487:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 9 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.477497:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919531.477501:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919531.477507:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 9 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.477540:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 9 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.477568:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 9 pid: 8082 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.477583:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978215168:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919531.477662:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919531.483365:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.483449:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958221952 00000100:00100000:3.0:1790919531.483458:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958221952 00010000:00010000:3.0:1790919531.483521:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 10 pid: 8082 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.483650:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978215168:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919531.483679:0:8084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 10 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.483696:0:8084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1cc00, rc 0) 00000100:00100000:1.0:1790919531.483757:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:11462:x1877914958221824:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6349us (6705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.483766:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790919531.483931:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790919531.483946:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958221952:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919531.483961:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919531.483981:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 9 pid: 8082 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.483995:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 9 pid: 8082 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.484027:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a935905/0x951c50ad15913d8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d20 expref: 9 pid: 8082 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.484043:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919531.484048:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919531.484091:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.484102:0:13233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.484159:0:13233:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919531.484174:0:13233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f381325c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13233:1877914978215296:192.168.203.11@tcp:105: 00000100:00100000:3.0:1790919531.484224:0:13233:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919531.486718:0:13233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f381325c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13233:1877914978215296:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790919531.486746:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919531.486802:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958221952:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2857us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.486813:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790919531.487288:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919531.488376:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958222208 00000100:00100000:0.0:1790919531.488388:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958222208 00000100:00100000:0.0:1790919531.488442:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790919531.488451:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:11462:x1877914958222208:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790919531.488918:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11462:x1877914958222208:12345-192.168.203.11@tcp:35:bash.0 Request processed in 410us (1573us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790919531.488927:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790919531.639323:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.639434:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958222336 00000100:00100000:2.0:1790919531.639445:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958222336 00000100:00100000:2.0:1790919531.639514:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:2.0:1790919531.639523:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:11478:x1877914958222336:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919531.639547:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919531.639567:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d2e expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.639629:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.639641:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.639648:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919531.639675:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790919531.639677:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919531.639690:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.639706:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d2e expref: 40 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.639733:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d2e expref: 39 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.639739:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919531.639741:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919531.639743:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919531.639811:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:11478:x1877914958222336:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 288us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.639817:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1790919531.654762:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919531.654880:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958222592 00000100:00100000:0.0:1790919531.654895:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958222592 00000100:00100000:0.0:1790919531.654972:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1790919531.654983:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:11478:x1877914958222592:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919531.655015:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919531.655038:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913da6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d35 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.655203:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913dad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.655231:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.655243:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919531.655256:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790919531.655390:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913da6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d35 expref: 42 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.655408:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d35 expref: 41 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.655418:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:0.0:1790919531.655420:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919531.655424:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014c00, rc 0) 00000100:00100000:0.0:1790919531.655505:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+41:11478:x1877914958222592:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 523us (759us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1790919531.655514:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1790919531.663891:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919531.663946:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.664026:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958222848 00000100:00100000:1.0:1790919531.664083:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958222848 00000100:00100000:1.0:1790919531.664436:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:1.0:1790919531.664447:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+41:11478:x1877914958222848:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919531.664487:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919531.664522:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913dbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d3c expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.664618:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913dc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.664633:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.664644:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919531.664656:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790919531.664884:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913dbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d3c expref: 44 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.664904:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d3c expref: 43 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.664914:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:1.0:1790919531.664917:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790919531.664921:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d600, rc 0) 00000100:00100000:2.0:1790919531.665308:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958222976 00000100:00100000:2.0:1790919531.665315:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958222976 00000100:00100000:2.0:1790919531.665361:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919531.665370:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:2412:x1877914958222976:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919531.665380:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919531.665394:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913dad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d35 expref: 44 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.665405:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:2.0:1790919531.665408:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919531.665552:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:11478:x1877914958222848:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1105us (1674us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1790919531.665563:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:2.0:1790919531.669430:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+42:2412:x1877914958222976:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 4048us (5470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.669445:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919531.680647:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.686191:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958223104 00000100:00100000:1.0:1790919531.686206:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958223104 00000100:00100000:1.0:1790919531.686288:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790919531.686299:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958223104:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:1.0:1790919531.686357:0:8083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.686378:0:8083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.686386:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919531.686390:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919531.686395:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.686429:0:8083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.686443:0:8083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 8 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.686457:0:8083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8083:1877914978215424:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919531.686564:0:8083:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919531.689228:0:8083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8083:1877914978215424:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919531.689256:0:8083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919531.693197:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.693401:0:8090:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958223232 00000100:00100000:2.0:1790919531.693411:0:8090:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958223232 00002000:00100000:2.0:1790919531.693472:0:8090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff95f39122ce00 x1877914958223232/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:652/0 lens 504/0 e 0 to 0 dl 1790919542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919531.693498:0:8090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f39122ce00 with x1877914958223232 ext(0->8) 00010000:00010000:2.0:1790919531.693514:0:8090:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 9 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.693532:0:8090:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 9 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919531.693540:0:8090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f39122ce00 00000100:00100000:2.0:1790919531.693566:0:8090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790919531.693576:0:8090:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958223232:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:2.0:1790919531.694011:0:8090:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2414:x1877914958223232:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 435us (825us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790919531.694019:0:8090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00100000:2.0:1790919531.694026:0:8090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff95f39122ce00 x1877914958223232/t4294967303(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:652/0 lens 504/448 e 0 to 0 dl 1790919542 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919531.694034:0:8090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f39122ce00 with x1877914958223232 ext(0->8) 00010000:00010000:2.0:1790919531.694040:0:8090:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 11 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.694093:0:8090:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 11 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919531.694101:0:8090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f39122ce00 00000100:00100000:3.0:1790919531.710196:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.710385:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958223360 00000100:00100000:2.0:1790919531.710411:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958223360 00010000:00010000:2.0:1790919531.710454:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 11 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.710514:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1790919531.710524:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2413:x1877914958223360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919531.710540:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790919531.710558:0:12731:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790919531.710561:0:12731:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790919532 00002000:00010000:2.0:1790919531.710563:0:12731:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790919532 00002000:00010000:2.0:1790919531.710565:0:12731:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790919532 00010000:00010000:2.0:1790919531.710571:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 11 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.710586:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 11 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.710621:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041286631/0x951c50ad15913d91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d27 expref: 11 pid: 8084 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.710639:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919531.710643:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919531.710648:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.710658:0:12731:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.710755:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919531.710815:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:2413:x1877914958223360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 291us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.710822:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00010000:00010000:1.0:1790919531.713787:0:8083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.713828:0:8083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714182:0:8083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714194:0:8083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714203:0:8083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714211:0:8083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1de00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919531.714215:0:8083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714224:0:8083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714244:0:8083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.714252:0:8083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b981dc/0x951c50ad15913dd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.714414:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958223104:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 28112us (33772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.714423:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:3.0:1790919531.731267:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.731405:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958223616 00000100:00100000:1.0:1790919531.731415:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958223616 00000100:00100000:1.0:1790919531.731483:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1790919531.731493:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+42:11478:x1877914958223616:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:1.0:1790919531.731558:0:6449:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d3c expref: 42 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919531.731847:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1790919531.731906:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1790919531.733306:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1790919531.733379:0:6449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.733396:0:6449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 46 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.733405:0:6449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.733440:0:6449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 46 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.733456:0:6449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 46 pid: 6445 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.733482:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6449:1877914978215552:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919531.733622:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919531.739435:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.739879:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958223744 00000100:00100000:1.0:1790919531.739888:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958223744 00010000:00010000:1.0:1790919531.739927:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 47 pid: 6445 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919531.739967:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790919531.739976:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+47:2414:x1877914958223744:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919531.739990:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919531.739996:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 47 pid: 6445 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.740009:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 47 pid: 6445 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.740047:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:1.0:1790919531.740086:0:6430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.740096:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.740104:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.740123:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919531.740174:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+47:2414:x1877914958223744:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919531.740181:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00010000:00010000:2.0:1790919531.741965:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913d7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d19 expref: 46 pid: 6445 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.741989:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6449:1877914978215552:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919531.742372:0:6449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.742382:0:6449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.742388:0:6449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919531.742537:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1790919531.742743:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1790919531.742853:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978215680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790919531.742916:0:6449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919531.742953:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382c2a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919531.742974:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978215680 00000100:00100000:3.0:1790919531.742982:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978215680 00000100:00100000:3.0:1790919531.743034:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790919531.743044:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6449:x1877914978215680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790919531.743142:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6449:x1877914978215680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919531.743150:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790919531.743585:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978215680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790919531.744375:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1790919531.744456:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978215808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790919531.744576:0:6449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919531.744674:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919531.744749:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978215808 00000100:00100000:3.0:1790919531.744756:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978215808 00000100:00100000:3.0:1790919531.744804:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790919531.744813:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6449:x1877914978215808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790919531.744985:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6449:x1877914978215808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 172us (409us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790919531.744993:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790919531.745332:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978215808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790919531.745378:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1790919531.745415:0:6449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.745425:0:6449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.745431:0:6449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.745446:0:6449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919531.745451:0:6449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.745469:0:6449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.745485:0:6449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:2.0:1790919531.745488:0:6449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790919531.745493:0:6449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.745499:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913dd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919531.745845:0:6449:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790919531.745947:0:6449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1790919531.745957:0:6449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340773903845ns, next at 341773901823ns, rc = 0 00000001:00080000:2.0:1790919531.745963:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1790919531.746372:0:6449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f392142000) 00010000:00010000:2.0:1790919531.746376:0:6449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790919531.746384:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913dc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d3c expref: 50 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.746505:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+49:11478:x1877914958223616:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 15013us (15246us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790919531.746514:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000020:00080000:2.0:1790919531.746519:0:6449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790919531.749243:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.749729:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958223872 00000100:00100000:2.0:1790919531.749739:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958223872 00000100:00100000:2.0:1790919531.749792:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1790919531.749803:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+49:11478:x1877914958223872:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919531.749828:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919531.749849:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913dde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d43 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.749921:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913dde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d43 expref: 50 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.749937:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913dde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d43 expref: 50 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.749955:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919531.749959:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919531.749962:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696200, rc 0) 00000100:00100000:2.0:1790919531.750022:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+50:11478:x1877914958223872:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 222us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.750030:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:0.0:1790919531.752902:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.753269:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958224128 00000100:00100000:3.0:1790919531.753279:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958224128 00000100:00100000:3.0:1790919531.753361:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790919531.753371:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+50:11478:x1877914958224128:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790919531.753605:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:11478:x1877914958224128:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 234us (710us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790919531.753613:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790919531.836488:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919531.836777:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958224256 00000100:00100000:3.0:1790919531.836787:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958224256 00000100:00100000:3.0:1790919531.836899:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:3.0:1790919531.836908:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:11488:x1877914958224256:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1790919531.836979:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837005:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837018:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837029:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837036:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837043:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837398:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837408:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837415:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919531.837455:0:10757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837477:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837484:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837490:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837496:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.837500:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837508:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837518:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919531.837521:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.837525:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837538:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913de5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837552:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837558:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837563:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837568:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.837571:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837577:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837584:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:3.0:1790919531.837586:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.837589:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837595:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913dec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837604:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837609:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837619:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837624:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919531.837627:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837634:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837641:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919531.837643:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919531.837646:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919531.837652:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913df3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919531.837719:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:11488:x1877914958224256:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 811us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919531.837727:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:0.0:1790919531.914480:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919531.914583:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958224512 00000100:00100000:1.0:1790919531.914592:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958224512 00000100:00100000:1.0:1790919531.914649:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:1.0:1790919531.914659:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:11491:x1877914958224512:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919531.914680:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919531.914699:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913dfa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d4a expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.914771:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.914785:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.914795:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.914819:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.914827:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.914846:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.915090:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.915100:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919531.915107:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919531.915116:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790919531.916109:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916188:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916268:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916274:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919531.916279:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916287:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916300:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919531.916303:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919531.916307:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916313:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913e01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916332:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916340:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916345:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916349:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919531.916359:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916365:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916373:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:0.0:1790919531.916375:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919531.916378:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916383:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad15913e08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916431:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913dfa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 54 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916446:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 53 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919531.916452:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919531.916455:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919531.916468:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1da00, rc 0) 00000100:00100000:0.0:1790919531.916658:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+53:11491:x1877914958224512:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1999us (2199us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790919531.916667:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:0.0:1790919531.921009:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.921248:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958224640 00000100:00100000:2.0:1790919531.921258:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958224640 00000100:00100000:2.0:1790919531.921331:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:2.0:1790919531.921342:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+53:11491:x1877914958224640:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790919531.921415:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921432:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921467:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921495:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921512:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921518:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921524:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919531.921529:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921536:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921547:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919531.921550:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919531.921555:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919531.921561:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919531.921676:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+53:11491:x1877914958224640:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 336us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919531.921685:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:0.0:1790919531.927879:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919531.927951:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958224896 00000100:00100000:2.0:1790919531.927972:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958224896 00000100:00100000:2.0:1790919531.928025:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1790919531.928035:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+53:11491:x1877914958224896:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919531.928292:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:11491:x1877914958224896:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 257us (433us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1790919531.928305:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00010000:00010000:3.0:1790919531.932714:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919532.012213:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.012544:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958225152 00000100:00100000:2.0:1790919532.012555:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958225152 00000100:00100000:2.0:1790919532.012615:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1790919532.012624:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:11501:x1877914958225152:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919532.012649:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919532.012652:0:7785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790919532.012677:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913d9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d2e expref: 54 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.012697:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919532.012701:0:7785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919532.012714:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e24 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d51 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.012807:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.012821:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 54 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.012830:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.012895:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 54 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.012909:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 54 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.012923:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978215936:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919532.013006:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919532.016324:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.016433:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958225280 00000100:00100000:1.0:1790919532.016442:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958225280 00010000:00010000:1.0:1790919532.016489:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 55 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.016539:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:1.0:1790919532.016549:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+55:2414:x1877914958225280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919532.016564:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919532.016570:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 55 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.016595:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 55 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.016616:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.016621:0:7709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.016631:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.016638:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.016657:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919532.016712:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+55:2414:x1877914958225280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 164us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919532.016720:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00010000:00010000:2.0:1790919532.016794:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15913e0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d4a expref: 54 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.016810:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978215936:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919532.016830:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.016839:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.016845:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919532.016870:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790919532.017011:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 55 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.017027:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 54 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.017045:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919532.017048:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919532.017080:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696000, rc 0) 00000100:00100000:2.0:1790919532.017106:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:11501:x1877914958225152:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4484us (4905us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790919532.017113:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:0.0:1790919532.020320:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.020403:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958225536 00000100:00100000:1.0:1790919532.020412:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958225536 00000100:00100000:1.0:1790919532.020475:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1790919532.020485:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:11501:x1877914958225536:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:1.0:1790919532.020743:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.020761:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.020771:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919532.020836:0:6446:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1790919532.020872:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d2c41b5b reply state 00000000d08c806d transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.020884:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.020892:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.020894:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919532.020897:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919532.021146:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+57:11501:x1877914958225536:12345-192.168.203.11@tcp:36:bash.0 Request processed in 662us (834us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790919532.021155:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000020:00080000:1.0:1790919532.021159:0:6446:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919532.024473:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.024609:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958225664 00000100:00100000:2.0:1790919532.024620:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958225664 00000100:00100000:2.0:1790919532.024677:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1790919532.024689:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+57:11501:x1877914958225664:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919532.024717:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919532.024738:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d58 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.024824:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.024839:0:6447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 58 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.024848:0:6447:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.024891:0:6447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 58 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.024905:0:6447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 58 pid: 7785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.024935:0:6447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978216064:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919532.025016:0:6447:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919532.027428:0:6447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978216064:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919532.027465:0:6447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919532.028981:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.029383:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958225792 00000100:00100000:2.0:1790919532.029393:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958225792 00010000:00010000:2.0:1790919532.029436:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 59 pid: 7785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.029485:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:2.0:1790919532.029495:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:2413:x1877914958225792:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919532.029620:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919532.029629:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 59 pid: 7785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.029641:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 59 pid: 7785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.029663:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d51 expref: 59 pid: 7785 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.029683:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919532.029687:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.029695:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.029721:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.029750:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919532.029809:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:2413:x1877914958225792:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 315us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.029816:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:3.0:1790919532.029884:0:6447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.029893:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919532.029944:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790919532.029949:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919532.029970:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.029998:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15913e40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 58 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.030013:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 57 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.030019:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919532.030022:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919532.030024:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:3.0:1790919532.030098:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+57:11501:x1877914958225664:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5365us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.030106:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1790919532.033637:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.033757:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958226048 00000100:00100000:0.0:1790919532.033766:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958226048 00000100:00100000:0.0:1790919532.033815:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1790919532.033825:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+57:11501:x1877914958226048:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790919532.034076:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:11501:x1877914958226048:12345-192.168.203.11@tcp:35:bash.0 Request processed in 225us (420us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1790919532.034085:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1790919532.081957:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.082679:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958226176 00000100:00100000:3.0:1790919532.082689:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958226176 00000100:00100000:2.0:1790919532.082851:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:2.0:1790919532.082869:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:11507:x1877914958226176:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919532.082892:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919532.082910:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d5f expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.082965:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913e55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.082978:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.082987:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919532.083022:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790919532.083026:0:10757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919532.083043:0:10757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.083086:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913e4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d5f expref: 60 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.083121:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d5f expref: 59 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.083138:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919532.083141:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919532.083144:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697800, rc 0) 00000100:00100000:2.0:1790919532.083244:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:11507:x1877914958226176:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 376us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.083252:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:3.0:1790919532.085615:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.085777:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958226304 00000100:00100000:0.0:1790919532.085787:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958226304 00000100:00100000:0.0:1790919532.085844:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1790919532.085854:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:11507:x1877914958226304:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919532.085977:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919532.085999:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d66 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086088:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086104:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086115:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086126:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086342:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086351:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086436:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086445:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086452:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919532.086499:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790919532.086504:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919532.086521:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086532:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086539:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086545:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086553:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086569:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919532.086573:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086581:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086592:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919532.086595:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919532.086599:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086606:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913e63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086619:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086625:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086633:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086638:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919532.086641:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086647:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086667:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:0.0:1790919532.086669:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919532.086673:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086679:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086706:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 61 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086720:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 60 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.086727:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919532.086729:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919532.086731:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014e00, rc 0) 00000100:00100000:0.0:1790919532.086797:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11507:x1877914958226304:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 943us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.086804:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1790919532.090448:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.090493:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958226560 00000100:00100000:3.0:1790919532.090512:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958226560 00000100:00100000:3.0:1790919532.090562:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:3.0:1790919532.090571:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11507:x1877914958226560:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919532.090590:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919532.090608:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913e78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d6d expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090729:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090743:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 61 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090750:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 61 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090758:0:13325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090789:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 61 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090801:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 61 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.090815:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978216192:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919532.090927:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 61 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.090936:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 61 pid: 6447 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.090944:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978216320:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919532.090979:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919532.091025:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.091046:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958226688 00000100:00100000:3.0:1790919532.091073:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958226688 00010000:00010000:3.0:1790919532.091093:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 62 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.091115:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1790919532.091122:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:2412:x1877914958226688:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919532.091142:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919532.091148:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 62 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.091159:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 62 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.091176:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919532.091181:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.091187:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.091194:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919532.091219:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:2412:x1877914958226688:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.091226:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1790919532.095603:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.095714:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958226816 00000100:00100000:2.0:1790919532.095723:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958226816 00010000:00010000:2.0:1790919532.095761:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 62 pid: 6447 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.095790:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1790919532.095798:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:2413:x1877914958226816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919532.095812:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919532.095818:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 62 pid: 6447 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.095829:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 62 pid: 6447 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.095849:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919532.095854:0:7709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.095876:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.095883:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.095902:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919532.095951:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:2413:x1877914958226816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 153us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.095958:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00010000:00010000:0.0:1790919532.098585:0:13325:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.11@tcp) returned -22 from blocking AST (req@00000000d1f85bb9 x1877914978216192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 61 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.098609:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913e71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d66 expref: 61 pid: 6445 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919532.098627:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978216192:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919532.098663:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913e47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d58 expref: 60 pid: 6447 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919532.098676:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978216320:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919532.098702:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919532.098710:0:13325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.098720:0:13325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.098727:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919532.098748:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790919532.098985:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15913e78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 61 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.099001:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 60 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.099009:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919532.099012:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919532.099014:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d200, rc 0) 00000100:00100000:0.0:1790919532.099261:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11507:x1877914958226560:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 8688us (8820us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1790919532.099270:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:3.0:1790919532.101758:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.101821:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227072 00000100:00100000:0.0:1790919532.101846:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227072 00000100:00100000:0.0:1790919532.101922:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1790919532.101933:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11507:x1877914958227072:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:0.0:1790919532.101948:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919532.101970:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913dde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d43 expref: 60 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.101992:0:6432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919532.101996:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919532.105800:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:11507:x1877914958227072:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 3851us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.105818:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919532.107985:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.108452:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227200 00000100:00100000:0.0:1790919532.108470:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227200 00000100:00100000:0.0:1790919532.108625:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:0.0:1790919532.108635:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:11507:x1877914958227200:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:0.0:1790919532.108746:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.108762:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.108773:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919532.109089:0:7785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1790919532.109177:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:11507:x1877914958227200:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 543us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.109186:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:1.0:1790919532.111617:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.111704:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227328 00000100:00100000:0.0:1790919532.111714:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227328 00000100:00100000:0.0:1790919532.111798:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:0.0:1790919532.111808:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:11507:x1877914958227328:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919532.111829:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919532.111850:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d74 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.111915:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.111927:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 60 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.111946:0:6445:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.111959:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 60 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.111972:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919532.111976:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919532.111979:0:6445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 60 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.111987:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015000, rc 0) 00000100:00100000:0.0:1790919532.112049:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11507:x1877914958227328:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 242us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.112080:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000040:00080000:2.0:1790919532.700315:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919532.700322:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919532.700362:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790919532.700368:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919532.700504:0:13302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978216448:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919532.700599:0:13302:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919532.705204:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.705368:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227456 00000100:00100000:0.0:1790919532.705376:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227456 00000100:00100000:2.0:1790919532.705424:0:13302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978216448:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919532.705432:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790919532.705440:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958227456:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919532.705478:0:10757:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919532.705890:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11508:x1877914958227456:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 449us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.705899:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790919532.708298:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.708504:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227584 00000100:00100000:1.0:1790919532.708512:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227584 00000100:00100000:1.0:1790919532.708564:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790919532.708574:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11508:x1877914958227584:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790919532.708653:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708670:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708680:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708711:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708719:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708724:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708745:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708754:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708760:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919532.708924:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790919532.708929:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919532.708951:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708963:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708970:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.708978:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709003:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.709008:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709017:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709029:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:1.0:1790919532.709032:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.709037:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709044:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913e9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709084:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709091:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709097:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709103:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.709105:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709111:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709128:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff95f392142400) 00010000:00010000:1.0:1790919532.709131:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.709381:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709391:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913ea2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709409:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709416:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709422:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709427:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.709430:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709436:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709445:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.709447:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.709459:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.709465:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.709617:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11508:x1877914958227584:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 1042us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919532.709626:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790919532.713510:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.713834:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227840 00000100:00100000:3.0:1790919532.713845:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227840 00000100:00100000:3.0:1790919532.714399:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1790919532.714415:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:11508:x1877914958227840:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919532.714436:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919532.714469:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913eb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d7b expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.714793:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.714809:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.714821:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919532.714832:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790919532.714952:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.714960:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.714966:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.714972:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919532.714976:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.715010:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.715022:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919532.715025:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919532.715030:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.715035:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15913eb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.715110:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913eb0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d7b expref: 62 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.715122:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919532.715125:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919532.715129:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913eb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d7b expref: 62 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.715138:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00100000:3.0:1790919532.715217:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958227840:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 806us (1718us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1790919532.715226:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1790919532.725125:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.725478:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958227968 00000100:00100000:0.0:1790919532.725489:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958227968 00000100:00100000:0.0:1790919532.725679:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1790919532.725690:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958227968:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919532.725729:0:13325:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919532.725860:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958227968:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 172us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.725869:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1790919532.731320:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.735351:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958228224 00000100:00100000:2.0:1790919532.735365:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958228224 00000100:00100000:2.0:1790919532.735735:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:2.0:1790919532.735745:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958228224:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919532.735766:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919532.735770:0:7785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790919532.735796:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913e55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d5f expref: 61 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.735814:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:2.0:1790919532.735833:0:7785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919532.735848:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913ec5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d82 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919532.737436:0:7785:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1790919532.738368:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913ecc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.738387:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.738398:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913ecc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.738467:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15913ec5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d82 expref: 63 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.738488:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913ecc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d82 expref: 62 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.739027:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f3930c1300) 00010000:00010000:2.0:1790919532.739030:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919532.739034:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919532.740298:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:11508:x1877914958228224:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 4546us (8980us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1790919532.740311:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1790919532.749990:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.750147:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958228480 00000100:00100000:0.0:1790919532.750157:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958228480 00000100:00100000:0.0:1790919532.750212:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:0.0:1790919532.750222:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:11508:x1877914958228480:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919532.750459:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919532.750486:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15913ecc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d82 expref: 62 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750597:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f3930c1300) 00010000:00010000:0.0:1790919532.750608:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919532.750628:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750641:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750648:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750661:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750667:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750672:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750730:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750737:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750743:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750748:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919532.750752:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750766:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750775:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:0.0:1790919532.750777:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919532.750781:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750787:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15913eda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750796:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750802:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750808:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750813:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919532.750816:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750821:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750827:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x44207fe4 (ffff95f382b81000) 00010000:00010000:0.0:1790919532.750830:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919532.750832:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.750846:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913ee1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x44207fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919532.752891:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958228480:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 2666us (2909us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919532.752901:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1790919532.756313:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.756527:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958228608 00000100:00100000:0.0:1790919532.756538:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958228608 00000100:00100000:0.0:1790919532.756601:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:0.0:1790919532.756611:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+61:11508:x1877914958228608:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919532.756635:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919532.756658:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913ee8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d89 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.756693:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.756705:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.756714:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.756803:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913ee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 63 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.756820:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 62 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.756840:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919532.756842:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790919532.756845:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015800, rc 0) 00000100:00100000:0.0:1790919532.757137:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:11508:x1877914958228608:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 527us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.757144:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:2.0:1790919532.763710:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.764023:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958228864 00000100:00100000:1.0:1790919532.764033:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958228864 00000100:00100000:1.0:1790919532.764231:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:1.0:1790919532.764242:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:11508:x1877914958228864:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790919532.764466:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.764483:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.764494:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919532.765589:0:6446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1790919532.765610:0:6446:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341793556498ns, next at 342793551315ns, rc = 0 00000004:00010000:1.0:1790919532.765704:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000061239ed8 reply state 00000000a4574d07 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.765720:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.765728:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919532.765731:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790919532.765735:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919532.767197:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:11508:x1877914958228864:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 2947us (3485us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790919532.767210:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:3.0:1790919532.770402:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.770504:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958228992 00000100:00100000:0.0:1790919532.770514:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958228992 00000100:00100000:0.0:1790919532.770574:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1790919532.770585:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:11508:x1877914958228992:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919532.770612:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919532.770634:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d90 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.770696:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 65 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.770710:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 65 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.770730:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919532.770733:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919532.770737:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015c00, rc 0) 00000100:00100000:0.0:1790919532.770804:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:11508:x1877914958228992:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 220us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.770828:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:3.0:1790919532.775632:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.775741:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958229120 00000100:00100000:0.0:1790919532.775751:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958229120 00000100:00100000:0.0:1790919532.775835:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1790919532.775845:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2412:x1877914958229120:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790919532.776505:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2412:x1877914958229120:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 659us (879us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790919532.776513:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00080000:1.0:1790919532.777470:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919532.779541:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.779672:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958229376 00000100:00100000:0.0:1790919532.779683:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958229376 00000100:00100000:0.0:1790919532.779777:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1790919532.779786:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:11508:x1877914958229376:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790919532.780015:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:11508:x1877914958229376:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 229us (482us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1790919532.780024:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790919532.782143:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.782285:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958229632 00000100:00100000:2.0:1790919532.782294:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958229632 00000100:00100000:2.0:1790919532.782362:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:2.0:1790919532.782372:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:11508:x1877914958229632:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790919532.782485:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:11508:x1877914958229632:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 114us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.782493:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1790919532.785328:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.785432:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958229760 00000100:00100000:2.0:1790919532.785442:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958229760 00000100:00100000:2.0:1790919532.785587:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1790919532.785598:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:11508:x1877914958229760:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919532.785618:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919532.785638:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913f04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d97 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.785705:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913f0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.785719:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.785730:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919532.785765:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919532.785782:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.785808:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15913f04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d97 expref: 68 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.785846:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d97 expref: 67 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.785927:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919532.785930:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790919532.785934:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696000, rc 0) 00000100:00100000:2.0:1790919532.786036:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:11508:x1877914958229760:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 440us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.786044:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1790919532.788709:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.789182:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958229888 00000100:00100000:3.0:1790919532.789192:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958229888 00000100:00100000:3.0:1790919532.789279:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:3.0:1790919532.789289:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2413:x1877914958229888:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919532.789307:0:8082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919532.789327:0:8082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38d9e expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919532.789354:0:8082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf436d, blocks: 0x1 00010000:00010000:3.0:1790919532.789373:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1790919532.789377:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919532.789386:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 10 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.789405:0:8082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 10 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.789418:0:8082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00100000:3.0:1790919532.789591:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:2413:x1877914958229888:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 302us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.789598:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1790919532.793339:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.793746:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230144 00000100:00100000:3.0:1790919532.793756:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230144 00000100:00100000:3.0:1790919532.793859:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:3.0:1790919532.793872:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:11508:x1877914958230144:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919532.793991:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:11508:x1877914958230144:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 121us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.794022:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1790919532.796991:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.797222:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230272 00000100:00100000:3.0:1790919532.797232:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230272 00000100:00100000:3.0:1790919532.797321:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1790919532.797331:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:11508:x1877914958230272:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919532.797349:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919532.797366:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38da5 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.797398:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.797408:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919532.797411:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919532.797416:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 11 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.797460:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.797475:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.797489:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8248:1877914978216576:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919532.797585:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919532.800376:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8248:1877914978216576:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919532.800413:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 11 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.800433:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ca00, rc 0) 00000100:00100000:3.0:1790919532.800503:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:11508:x1877914958230272:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3174us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.800513:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1790919532.804687:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.804781:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230400 00000100:00100000:3.0:1790919532.804792:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230400 00010000:00010000:3.0:1790919532.804832:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.804886:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1790919532.804895:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2414:x1877914958230400:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919532.804928:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919532.804951:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.804965:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.804989:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d9e expref: 11 pid: 8082 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.805299:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919532.805310:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919532.805319:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 10 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.805331:0:13233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 10 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.805437:0:13233:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 10 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.805463:0:13233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13233:1877914978216704:192.168.203.11@tcp:105: 00000100:00100000:2.0:1790919532.805549:0:13233:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919532.813752:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.813837:0:8088:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230528 00000100:00100000:3.0:1790919532.813847:0:8088:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230528 00002000:00100000:3.0:1790919532.813976:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff95f2839af800 x1877914958230528/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:653/0 lens 504/0 e 0 to 0 dl 1790919543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919532.813987:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f2839af800 with x1877914958230528 ext(0->12) 00002000:00010000:3.0:1790919532.814288:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f2839af800 00000100:00100000:3.0:1790919532.814325:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1790919532.814335:0:8088:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2414:x1877914958230528:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790919532.815628:0:13233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13233:1877914978216704:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790919532.815654:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919532.815731:0:8088:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2414:x1877914958230528:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 1396us (1989us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790919532.815740:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:3.0:1790919532.815749:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff95f2839af800 x1877914958230528/t4294967309(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:653/0 lens 504/448 e 0 to 0 dl 1790919543 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919532.815758:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f2839af800 with x1877914958230528 ext(0->12) 00002000:00010000:3.0:1790919532.815762:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f2839af800 00000100:00100000:2.0:1790919532.815951:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:2414:x1877914958230400:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 11056us (11272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.815959:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:2.0:1790919532.819338:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919532.819443:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230656 00000100:00100000:0.0:1790919532.819462:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230656 00000100:00100000:0.0:1790919532.819603:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1790919532.819615:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:11508:x1877914958230656:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1790919532.877684:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:11508:x1877914958230656:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 58062us (58345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.877713:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000001:00080000:2.0:1790919532.877767:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1790919532.877793:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1790919532.877833:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:1.0:1790919532.878471:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878482:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878490:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878496:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.878501:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878508:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878522:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff95f3930c1c00) 00010000:00010000:1.0:1790919532.878525:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.878529:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878534:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad15913c3a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878569:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878575:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878580:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878585:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.878587:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878593:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878599:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:1.0:1790919532.878614:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.878617:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878622:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913cd4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878637:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878644:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878649:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878661:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.878664:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878670:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878678:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:1.0:1790919532.878681:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.878683:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878689:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913d52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878700:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878706:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878712:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878717:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.878719:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878724:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878741:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81100) 00010000:00010000:1.0:1790919532.878743:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.878746:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878752:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913d75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878768:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878774:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878779:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878784:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.878787:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878793:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878800:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.878802:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.878804:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878809:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913e39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878830:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878836:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.878843:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.879047:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.879107:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.879116:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.879128:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919532.879130:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790919532.879134:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.879141:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913ef6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.879165:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919532.879183:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978216960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790919532.879251:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919532.879306:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978216960 00000100:00100000:1.0:1790919532.879315:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978216960 00000100:00100000:1.0:1790919532.879359:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919532.879374:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978216960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790919532.879533:0:8083:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790919532.879536:0:8083:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790919533 00002000:00010000:1.0:1790919532.879539:0:8083:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790919532.879541:0:8083:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790919533 -> 1790919533 00002000:00010000:1.0:1790919532.879543:0:8083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790919532.879581:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3459:x1877914978216960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (330us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790919532.879587:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1790919532.879627:0:3459:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f39122ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790919532.879633:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978216960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919532.879750:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978216832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790919532.879779:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919532.880223:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978216832 00000100:00100000:1.0:1790919532.880228:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978216832 00000100:00100000:1.0:1790919532.880294:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919532.880302:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3461:x1877914978216832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790919532.880319:0:8084:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1790919532.880336:0:8084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.880354:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 11 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.880362:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790919532.880366:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919532.880370:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.880410:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 11 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.880423:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 11 pid: 8248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.880434:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8084:1877914978217088:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919532.880517:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6c00 going to sleep for 11 seconds 00000004:00080000:2.0:1790919532.881537:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790919532.881559:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f285f86840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790919532.881564:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f382f22400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f3b66f9540 00000020:00080000:2.0:1790919532.881568:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f382f22e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f3b5a6fc00 00000020:00080000:2.0:1790919532.881622:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f284c00cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790919532.881626:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f382f42600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f284c00d80 00000020:00080000:2.0:1790919532.881629:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f382f42f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f2839a4c00 00000020:00080000:2.0:1790919532.881645:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1790919532.881822:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790919532.882286:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919532.882300:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978217216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790919532.882350:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919532.885473:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.886551:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978217216 00000100:00100000:3.0:1790919532.886562:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978217216 00000100:00100000:0.0:1790919532.890969:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.891030:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230784 00000100:00100000:1.0:1790919532.891040:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230784 00000100:00100000:1.0:1790919532.891105:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919532.891115:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3458:x1877914978217216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790919532.891145:0:8083:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1790919532.891177:0:8083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abf436c, atime: 0x6abf436c, ctime: 0x6abf436c, blocks: 0x1 00010000:00010000:1.0:1790919532.891185:0:8083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.891199:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1790919532.891204:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919532.891211:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.891227:0:8083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.891259:0:8083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.891267:0:8083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.891286:0:8083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790919532.891803:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3458:x1877914978217216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 689us (9451us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790919532.891811:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919532.891833:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1790919532.891840:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:2413:x1877914958230784:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1790919532.891905:0:3458:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f3b5eef100/2, rc 0, transno 4294967305 00000100:00100000:1.0:1790919532.891911:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978217216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790919532.891938:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8084:1877914978217088:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919532.891956:0:8084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.893799:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919532.893813:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.893827:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919532.893831:0:6434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.893843:0:6434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.893863:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.893872:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6dba330/0x951c50ad15913f27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.893899:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919532.893900:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919532.893902:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919532.898263:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958230912 00000100:00100000:2.0:1790919532.898278:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958230912 00010000:00010000:2.0:1790919532.898326:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 13 pid: 8248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.898371:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:2.0:1790919532.898381:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2414:x1877914958230912:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919532.898396:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919532.898415:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 13 pid: 8248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.898429:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 13 pid: 8248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.898466:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063330b95/0x951c50ad15913ce2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d04 expref: 13 pid: 8248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.898486:0:7709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919532.898490:0:7709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919532.898496:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.898506:0:7709:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.898530:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919532.898585:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:2414:x1877914958230912:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 205us (7626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.898592:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00010000:00010000:1.0:1790919532.899694:0:8084:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.899711:0:8084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.899738:0:8084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.899746:0:8084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.899769:0:8084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790919532.900392:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3461:x1877914978216832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20088us (20608us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790919532.900402:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1790919532.900491:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919532.900499:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.900509:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919532.900513:0:7708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919532.900515:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f39122c700/2, rc 0, transno 4294967311 00000100:00100000:2.0:1790919532.900525:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978216832:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790919532.900542:0:7708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.900559:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.900565:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec186c7/0x951c50ad15913f20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.900584:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919532.900586:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919532.900588:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919532.954645:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2413:x1877914958230784:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 62795us (69168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919532.954658:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000001:00080000:2.0:1790919532.954795:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1790919532.954807:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1790919532.954820:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:3.0:1790919532.956481:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919532.964146:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.964407:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958231168 00000100:00100000:1.0:1790919532.964417:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958231168 00000100:00100000:1.0:1790919532.964479:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1790919532.964488:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:11508:x1877914958231168:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790919532.964541:0:6446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919532.964563:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15913f0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d97 expref: 15 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.964583:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919532.964587:0:6446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919532.964626:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.964649:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.964676:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919532.965303:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000db8ea573 reply state 000000007882f723 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.965317:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.965323:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919532.965326:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919532.965328:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919532.965407:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:11508:x1877914958231168:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 919us (1268us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1790919532.965414:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1790919532.967700:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919532.967799:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958231296 00000100:00100000:2.0:1790919532.967818:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958231296 00000100:00100000:2.0:1790919532.967945:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1790919532.967956:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958231296:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790919532.968179:0:8082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790919532.968182:0:8082:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790919533 -> 1790919532 00002000:00010000:2.0:1790919532.968185:0:8082:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790919532 00002000:00010000:2.0:1790919532.968187:0:8082:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790919533 -> 1790919532 00002000:00010000:2.0:1790919532.968189:0:8082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790919532.968250:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2412:x1877914958231296:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 296us (557us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790919532.968258:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790919532.970361:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.970429:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958231552 00000100:00100000:1.0:1790919532.970437:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958231552 00000100:00100000:1.0:1790919532.970507:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:1.0:1790919532.970517:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:11508:x1877914958231552:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790919532.970580:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.970598:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 16 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.970607:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.970656:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 16 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.970670:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 16 pid: 13325 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.970684:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978217344:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919532.970754:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919532.972581:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978217344:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919532.972607:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919532.972907:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.973141:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958231680 00000100:00100000:1.0:1790919532.973148:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958231680 00010000:00010000:1.0:1790919532.973177:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 17 pid: 13325 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.973212:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:1.0:1790919532.973219:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:2413:x1877914958231680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919532.973231:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919532.973237:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 17 pid: 13325 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.973248:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 17 pid: 13325 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.973288:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d89 expref: 17 pid: 13325 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.973303:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919532.973307:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.973316:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.973322:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.973344:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919532.973384:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:2413:x1877914958231680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 165us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919532.973391:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00010000:00010000:3.0:1790919532.973637:0:6445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973654:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973681:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973689:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973696:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973702:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919532.973706:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973714:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973723:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:3.0:1790919532.973726:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790919532.973730:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.973736:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913f35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.973775:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:11508:x1877914958231552:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 3260us (3422us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790919532.973782:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1790919532.976043:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.977071:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958231808 00000100:00100000:3.0:1790919532.977083:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958231808 00000100:00100000:3.0:1790919532.977133:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790919532.977141:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2411:x1877914958231808:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790919532.977180:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.977199:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.977209:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790919532.977213:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919532.977218:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.977248:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.977260:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 7 pid: 8248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.977273:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8248:1877914978217472:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919532.977389:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919532.979459:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8248:1877914978217472:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919532.979488:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919532.980192:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.980429:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958231936 00000100:00100000:1.0:1790919532.980437:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958231936 00010000:00010000:1.0:1790919532.980483:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 8 pid: 8248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.980527:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:1.0:1790919532.980537:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958231936:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919532.980551:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919532.980570:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 8 pid: 8248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.980597:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 8 pid: 8248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.980622:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15913f19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38da5 expref: 8 pid: 8248 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.980635:0:6430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919532.980640:0:6430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919532.980645:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.980655:0:6430:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.980685:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919532.980732:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958231936:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 196us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919532.980740:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00010000:00010000:3.0:1790919532.980792:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980801:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980824:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980833:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980841:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980857:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ce00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919532.980861:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980870:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980883:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.980902:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae88e73/0x951c50ad15913f3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.980942:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958231808:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 3802us (4906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.980949:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1790919532.982764:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.982839:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958232192 00000100:00100000:3.0:1790919532.982855:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958232192 00000100:00100000:3.0:1790919532.982902:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:3.0:1790919532.982911:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:11508:x1877914958232192:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790919532.982980:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.982997:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.983007:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.983271:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.983283:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 16 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.983291:0:13325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.983331:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 16 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.983345:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 16 pid: 6447 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919532.983359:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978217600:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919532.983429:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919532.986297:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919532.986397:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978217600:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919532.986424:0:13325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.986509:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958232320 00000100:00100000:2.0:1790919532.986516:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958232320 00010000:00010000:2.0:1790919532.986555:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 17 pid: 6447 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919532.986590:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:2.0:1790919532.986599:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:2414:x1877914958232320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919532.986613:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919532.986619:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 17 pid: 6447 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.986629:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 17 pid: 6447 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.986649:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15913efd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d90 expref: 17 pid: 6447 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.986681:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919532.986686:0:7709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.986695:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.986702:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.986730:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919532.986787:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:2414:x1877914958232320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 187us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919532.986794:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00010000:00010000:3.0:1790919532.986962:0:13325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919532.986969:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919532.987145:0:13325:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1790919532.987279:0:13325:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1790919532.987319:0:13325:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1790919532.987394:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13325:1877914978217728:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1790919532.987440:0:13325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919532.987479:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d1fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919532.987548:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978217728 00000100:00100000:1.0:1790919532.987553:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978217728 00000100:00100000:1.0:1790919532.987592:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790919532.987599:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13325:x1877914978217728:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1790919532.987673:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13325:x1877914978217728:12345-0@lo:1000:mdt00_005.0 Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919532.987680:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790919532.987717:0:13325:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790919532.987723:0:13325:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1790919532.987739:0:13325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f39122ea00, transno 4294967310 00000100:00100000:1.0:1790919532.987751:0:13325:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff95f39122c700 x1877914978216832/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790919548 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919532.987760:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13325:1877914978217728:0@lo:1000:mdt00_005.0 00000001:00080000:1.0:1790919532.988203:0:13325:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1790919532.988250:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13325:1877914978217856:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1790919532.988278:0:13325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919532.988294:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919532.988542:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978217856 00000100:00100000:3.0:1790919532.988547:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978217856 00000100:00100000:3.0:1790919532.988581:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790919532.988589:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13325:x1877914978217856:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1790919532.988735:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13325:x1877914978217856:12345-0@lo:1000:mdt00_005.0 Request processed in 146us (455us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790919532.988742:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790919532.988810:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13325:1877914978217856:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1790919532.988838:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988847:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988854:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988859:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.988864:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988871:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988884:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919532.988886:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919532.988896:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988902:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15913f4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988922:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988927:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988933:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988937:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.988940:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988944:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988951:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.988953:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919532.988958:0:13325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988968:0:13325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.988976:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.989012:0:13325:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 19 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.989023:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f286813100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978217984:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790919532.989110:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790919532.992141:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919532.992443:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f286813100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978217984:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790919532.992479:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992495:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15913e8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992524:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992537:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992547:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992557:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992563:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992569:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992590:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.992594:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992601:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992611:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.992614:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919532.992618:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992623:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15913f51 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992633:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992639:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992644:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992649:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919532.992651:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992657:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992674:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919532.992676:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790919532.992680:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919532.992685:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15913f43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919532.993030:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11508:x1877914958232192:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 10118us (10271us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1790919532.993040:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000020:00080000:1.0:1790919532.993045:0:13325:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790919532.993199:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958232448 00000100:00100000:3.0:1790919532.993206:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958232448 00000100:00100000:3.0:1790919532.993258:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790919532.993266:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11507:x1877914958232448:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:3.0:1790919532.993352:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11507:x1877914958232448:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 87us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919532.993360:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790919532.995742:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000040:00080000:2.0:1790919532.995775:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919532.995780:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1790919532.996099:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958232704 00000100:00100000:0.0:1790919532.996108:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958232704 00000100:00100000:0.0:1790919532.996161:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1790919532.996186:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390320050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:11508:x1877914958232704:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1790919532.996607:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790919532.996618:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1790919532.997269:0:6448:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790919532.997379:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1790919532.997426:0:6448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.997442:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.997463:0:6448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.997471:0:6448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.997477:0:6448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.997484:0:6448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919532.997601:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919532.997746:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919532.997754:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.997761:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919532.997765:0:6434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.997774:0:6434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.997795:0:6434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919532.997798:0:6434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790919532.997802:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.997808:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913f58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919532.997819:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919532.997820:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919532.997822:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919532.997858:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390320050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11508:x1877914958232704:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1672us (2123us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1790919532.997867:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000020:00080000:0.0:1790919532.997872:0:6448:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790919533.003896:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919533.003985:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958232960 00000100:00100000:2.0:1790919533.003995:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958232960 00000100:00100000:2.0:1790919533.004069:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1790919533.004078:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11507:x1877914958232960:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:2.0:1790919533.004412:0:6446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1790919533.004509:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11507:x1877914958232960:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 431us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919533.004517:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00080000:3.0:1790919533.004916:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919533.026147:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919533.026243:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958233088 00000100:00100000:0.0:1790919533.026254:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958233088 00000100:00100000:0.0:1790919533.026315:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1790919533.026325:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:11511:x1877914958233088:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919533.026365:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919533.026386:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913f5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38dac expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026460:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026475:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026485:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026499:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026506:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026512:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026723:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026734:0:6447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 22 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026742:0:6447:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026773:0:6447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 22 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919533.026795:0:6447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 22 pid: 13325 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919533.026809:0:6447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978218112:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919533.026897:0:6447:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f287335e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919533.030808:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919533.030913:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958233344 00000100:00100000:1.0:1790919533.030924:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958233344 00000100:00100000:1.0:1790919533.030974:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1790919533.030985:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:6384:x1877914958233344:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790919533.031268:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:6384:x1877914958233344:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 283us (466us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1790919533.031276:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790919533.031839:0:6447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978218112:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919533.031876:0:6447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919533.033551:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919533.033638:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958233472 00000100:00100000:2.0:1790919533.033646:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958233472 00010000:00010000:2.0:1790919533.033681:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 24 pid: 13325 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919533.033720:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1790919533.033729:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:2413:x1877914958233472:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919533.033742:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919533.033759:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 24 pid: 13325 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919533.033771:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 24 pid: 13325 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919533.033791:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15913e7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d6d expref: 24 pid: 13325 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919533.033806:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919533.033811:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919533.033821:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919533.033828:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919533.033859:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919533.033911:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:2413:x1877914958233472:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 183us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919533.033917:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00010000:00010000:3.0:1790919533.034232:0:6447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034241:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919533.034278:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790919533.034282:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919533.034297:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034308:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034322:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034329:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034335:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034340:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919533.034344:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034351:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034359:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:3.0:1790919533.034361:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919533.034365:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034371:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913f66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034380:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034385:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034391:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034400:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919533.034403:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034408:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034415:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff95f382b81d00) 00010000:00010000:3.0:1790919533.034417:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919533.034419:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034424:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913f6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034466:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913f5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dac expref: 23 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034480:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dac expref: 22 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919533.034486:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919533.034489:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919533.034491:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015800, rc 0) 00000100:00100000:3.0:1790919533.034528:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11511:x1877914958233088:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 8205us (8391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919533.034535:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000001:00080000:3.0:1790919533.547789:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1790919533.547815:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:2.0:1790919533.717375:0:13778:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919533.717385:0:13778:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919533.717434:0:13778:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790919533.718081:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790919533.981285:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919534.044397:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919534.044408:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919534.044456:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790919534.044475:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919534.044611:0:13302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3bbfd7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978218240:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919534.044714:0:13302:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c009c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919534.049905:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919534.050173:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958233600 00000100:00100000:0.0:1790919534.050182:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958233600 00000100:00100000:0.0:1790919534.050351:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:0.0:1790919534.050362:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11524:x1877914958233600:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919534.050400:0:10757:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919534.050524:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11524:x1877914958233600:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 163us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919534.050531:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:2.0:1790919534.053556:0:13302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3bbfd7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978218240:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790919534.056410:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919534.059849:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958233856 00000100:00100000:1.0:1790919534.059867:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958233856 00000100:00100000:1.0:1790919534.060010:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:1.0:1790919534.060020:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:11524:x1877914958233856:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919534.060083:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919534.060108:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913f7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38db3 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.060222:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913f82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.060237:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913f82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.060248:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913f82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919534.060259:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790919534.060384:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad15913f7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38db3 expref: 25 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.060404:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913f82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38db3 expref: 24 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.060413:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919534.060416:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919534.060420:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d200, rc 0) 00000100:00100000:1.0:1790919534.060496:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11524:x1877914958233856:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 477us (4094us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790919534.060503:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:3.0:1790919534.073669:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919534.073708:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919534.073815:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958234240 00000100:00100000:0.0:1790919534.073825:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958234240 00000100:00100000:0.0:1790919534.073887:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790919534.073896:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:2413:x1877914958234240:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919534.073911:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919534.073933:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15913f82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38db3 expref: 24 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919534.073954:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:0.0:1790919534.073972:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919534.074115:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:2413:x1877914958234240:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 218us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919534.074123:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919534.074646:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958234112 00000100:00100000:1.0:1790919534.074653:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958234112 00000100:00100000:1.0:1790919534.074698:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:1.0:1790919534.074715:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:11524:x1877914958234112:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790919534.074791:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.074806:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.074817:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.074980:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.074988:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.074995:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.075000:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919534.075005:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.075013:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.075023:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919534.075026:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790919534.075030:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919534.075036:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15913f90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919534.075176:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11524:x1877914958234112:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 462us (1516us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1790919534.075184:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000040:00080000:2.0:1790919534.075634:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919534.075640:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919534.076134:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790919534.076143:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790919534.081342:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919534.082156:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958234496 00000100:00100000:1.0:1790919534.082167:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958234496 00000100:00100000:1.0:1790919534.082257:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1790919534.082268:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:11524:x1877914958234496:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790919534.082524:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11524:x1877914958234496:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 258us (1190us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790919534.082532:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1790919534.492662:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919534.492756:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978218368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919534.492819:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919534.492833:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978218496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919534.492923:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919534.493034:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919534.496467:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978218496 00000100:00100000:1.0:1790919534.496482:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978218496 00000100:00100000:3.0:1790919534.500529:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978218368 00000100:00100000:3.0:1790919534.500546:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978218368 00000100:00100000:3.0:1790919534.500621:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790919534.500632:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978218496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919534.500677:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1790919534.500764:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978218496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (7840us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919534.500771:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790919534.500789:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790919534.500794:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978218368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919534.500812:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919534.500843:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978218368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (7809us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919534.500848:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790919534.501026:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978218368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919534.501212:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978218496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919534.539922:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919534.539977:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919534.540126:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958234624 00000100:00100000:2.0:1790919534.540131:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958234752 00000100:00100000:0.0:1790919534.540136:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958234624 00000100:00100000:2.0:1790919534.540138:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958234752 00000100:00100000:0.0:1790919534.540188:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:2.0:1790919534.540204:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1790919534.540215:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958234752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919534.540224:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958234624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1790919534.540315:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919534.540383:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958234752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 169us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919534.540389:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1790919534.543314:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958234624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3106us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919534.543330:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:2.0:1790919534.560726:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919534.560876:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919534.560919:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919534.561014:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235136 00000100:00100000:3.0:1790919534.561036:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235136 00000100:00100000:3.0:1790919534.561114:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1790919534.561138:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958235136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919534.561212:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958235136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919534.561220:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00080000:0.0:1790919534.561891:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919534.562470:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919534.562670:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235264 00000100:00100000:0.0:1790919534.562678:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235264 00000100:00100000:0.0:1790919534.562736:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:0.0:1790919534.562744:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958235264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919534.562801:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958235264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 57us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919534.562807:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00080000:2.0:1790919534.563198:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919534.563383:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958234880 00000100:00100000:1.0:1790919534.563389:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958234880 00000100:00100000:0.0:1790919534.563509:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235008 00000100:00100000:0.0:1790919534.563514:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235008 00000100:00080000:2.0:1790919534.563775:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919534.563779:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919534.563818:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1790919534.563828:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958234880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919534.563888:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2411:x1877914958234880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 62us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919534.563894:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1790919534.564376:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1790919534.564385:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958235008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919534.564418:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2411:x1877914958235008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919534.564424:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00010000:00010000:3.0:1790919535.004520:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919535.004604:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978218624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919535.004670:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919535.004793:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919535.004800:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978218752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919535.004825:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919535.005613:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978218624 00000100:00100000:3.0:1790919535.005621:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978218624 00000100:00100000:3.0:1790919535.006136:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978218752 00000100:00100000:3.0:1790919535.006141:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978218752 00000100:00100000:1.0:1790919535.006857:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790919535.006872:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978218624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919535.006909:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919535.006972:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978218624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919535.006995:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790919535.007045:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978218624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790919535.007408:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919535.007570:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790919535.007578:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978218752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919535.007590:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919535.007633:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978218752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919535.007639:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919535.007733:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978218752:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1790919535.597598:0:13829:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919535.597612:0:13829:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919535.597670:0:13829:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790919535.597680:0:13829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790919535.820596:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919535.821286:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235520 00000100:00100000:3.0:1790919535.821301:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235520 00000100:00100000:3.0:1790919535.821383:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:3.0:1790919535.821395:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:11544:x1877914958235520:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919535.821440:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919535.821467:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913f97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38dba expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.821593:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913f9e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.821612:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913f9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.821641:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913f9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919535.821655:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790919535.821822:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15913f97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dba expref: 28 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.821844:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913f9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dba expref: 27 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.821854:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919535.821857:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790919535.821862:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00100000:3.0:1790919535.821948:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:11544:x1877914958235520:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 554us (1364us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790919535.821956:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00080000:0.0:1790919535.822354:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919535.834333:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919535.834787:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235648 00000100:00100000:3.0:1790919535.834801:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235648 00000100:00100000:3.0:1790919535.835008:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:3.0:1790919535.835021:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:11544:x1877914958235648:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1790919535.835131:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835153:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835167:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835209:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835217:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835225:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835232:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919535.835238:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835246:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835261:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919535.835264:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919535.835270:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919535.835277:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15913fac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919535.835368:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:11544:x1877914958235648:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 349us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919535.835377:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:3.0:1790919535.919970:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919535.920280:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235776 00000100:00100000:2.0:1790919535.920294:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235776 00000100:00100000:2.0:1790919535.920502:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1790919535.920516:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958235776:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1790919535.920543:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919535.920581:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb374c0/0x951c50ad15913fb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38dc1 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919535.920614:0:8248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abf436c, atime: 0x6abf436c, ctime: 0x6abf436c, blocks: 0xb 00010000:00010000:2.0:1790919535.920642:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1790919535.920646:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919535.920658:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb374c0/0x951c50ad15913fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dc1 expref: 7 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919535.920681:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009cb374c0/0x951c50ad15913fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dc1 expref: 7 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919535.920699:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696200, rc 0) 00000100:00100000:2.0:1790919535.920791:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958235776:12345-192.168.203.11@tcp:101:cat.0 Request processed in 278us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919535.920800:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1790919535.936747:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919535.937188:0:8089:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958235904 00000100:00100000:1.0:1790919535.937201:0:8089:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958235904 00002000:00100000:1.0:1790919535.937255:0:8089:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff95f283901180 x1877914958235904/t0(0) o3->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:656/0 lens 488/0 e 0 to 0 dl 1790919546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919535.937264:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f283901180 with x1877914958235904 ext(0->4095) 00002000:00010000:1.0:1790919535.937270:0:8089:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f283901180 00000100:00100000:1.0:1790919535.937302:0:8089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790919535.937310:0:8089:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958235904:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:1.0:1790919535.937649:0:8089:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958235904:12345-192.168.203.11@tcp:3:cat.0 Request processed in 337us (917us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790919535.937658:0:8089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:1.0:1790919535.937665:0:8089:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff95f283901180 x1877914958235904/t0(0) o3->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:656/0 lens 488/4536 e 0 to 0 dl 1790919546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919535.937673:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f283901180 with x1877914958235904 ext(0->4095) 00002000:00010000:1.0:1790919535.937677:0:8089:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f283901180 00010000:00010000:2.0:1790919536.028278:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919536.540600:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978218880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919536.540715:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919536.540839:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978219008:0@lo:400:kworker.0 00000100:00100000:1.0:1790919536.540891:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919536.540949:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219008 00000100:00100000:1.0:1790919536.540959:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219008 00000100:00100000:1.0:1790919536.541028:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1790919536.541039:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978219008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919536.541170:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978219008:12345-0@lo:400:kworker.0 Request processed in 129us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919536.541179:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1790919536.541229:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978218880 00000100:00100000:2.0:1790919536.541240:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978218880 00000100:00100000:1.0:1790919536.541263:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978219008:0@lo:400:kworker.0 00000100:00100000:1.0:1790919536.541322:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978219136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919536.541352:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919536.541388:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219136 00000100:00100000:1.0:1790919536.541393:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219136 00000100:00100000:1.0:1790919536.541444:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790919536.541451:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978219136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919536.541490:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919536.541547:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790919536.541550:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978219136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919536.541565:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790919536.541567:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978218880:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790919536.541592:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1790919536.541596:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919536.541623:0:3458:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1790919536.541632:0:3458:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1790919536.541652:0:3458:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f3b5a6b800, transno 4294967302 00000004:00080000:1.0:1790919536.541665:0:3458:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1790919536.541680:0:3458:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f3b5eef100, transno 4294967305 00000100:00100000:1.0:1790919536.541694:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978219136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919536.543453:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978219392:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.543538:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.543574:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978219904:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.543601:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.543620:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978220416:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.543642:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.543668:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790919536.543673:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978219520:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.543699:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.545227:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978220032:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.545290:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.545359:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219392 00000100:00100000:3.0:1790919536.545368:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219392 00000100:00100000:3.0:1790919536.545435:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219520 00000100:00100000:3.0:1790919536.545439:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219520 00000100:00100000:3.0:1790919536.545460:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790919536.545470:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978219392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.545540:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978219392:12345-0@lo:400:kworker.0 Request processed in 71us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.545547:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790919536.545566:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790919536.545572:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978219520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.545601:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978219520:12345-0@lo:400:kworker.0 Request processed in 29us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.545607:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790919536.545629:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219904 00000100:00100000:3.0:1790919536.545633:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219904 00000100:00100000:3.0:1790919536.545688:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220416 00000100:00100000:3.0:1790919536.545691:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220416 00000100:00100000:3.0:1790919536.545711:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790919536.545717:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978219904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.545753:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978219904:12345-0@lo:400:kworker.0 Request processed in 35us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.545760:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790919536.545772:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790919536.545778:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978220416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.545806:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978220416:12345-0@lo:400:kworker.0 Request processed in 28us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.545813:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:3.0:1790919536.547220:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919536.547286:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978219520:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547299:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978219392:0@lo:400:kworker.0 00010000:00080000:3.0:1790919536.547311:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f283903b80 x1877914978219904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919536.547320:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978219904:0@lo:400:kworker.0 00010000:00080000:3.0:1790919536.547329:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f283900000 x1877914978220416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919536.547334:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978220416:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547389:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978219648:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547473:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.547516:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978220160:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547566:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.547600:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790919536.547609:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978219264:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547634:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.547655:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978219776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547680:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.547699:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f283900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978220288:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.547721:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919536.547750:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219648 00000100:00100000:3.0:1790919536.547756:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219648 00000100:00100000:3.0:1790919536.547792:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219264 00000100:00100000:3.0:1790919536.547795:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219264 00000100:00100000:3.0:1790919536.547809:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978219776 00000100:00100000:3.0:1790919536.547812:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978219776 00000100:00100000:1.0:1790919536.547902:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220032 00000100:00100000:1.0:1790919536.547908:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220032 00000100:00100000:1.0:1790919536.547939:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220160 00000100:00100000:1.0:1790919536.547943:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220160 00000100:00100000:1.0:1790919536.547980:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919536.547999:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978220032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.548682:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220288 00000100:00100000:3.0:1790919536.548692:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220288 00000100:00100000:3.0:1790919536.548717:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790919536.548724:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978219648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.548794:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978219648:12345-0@lo:400:kworker.0 Request processed in 70us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.548802:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790919536.548820:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790919536.548894:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978219264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.548933:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978219264:12345-0@lo:400:kworker.0 Request processed in 106us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.548940:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790919536.548952:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790919536.548969:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978219776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.548999:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978219776:12345-0@lo:400:kworker.0 Request processed in 31us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.549005:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790919536.549018:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1790919536.549023:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978220288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.549049:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978220288:12345-0@lo:400:kworker.0 Request processed in 26us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.550604:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790919536.550651:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978220032:12345-0@lo:400:kworker.0 Request processed in 2650us (5357us total) trans 0 rc 0/0 00000100:00080000:3.0:1790919536.550663:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919536.550663:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919536.550696:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790919536.550715:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978220160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.550742:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978219264:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.550761:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978219776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919536.550775:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978220288:0@lo:400:kworker.0 00000100:00100000:1.0:1790919536.550793:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978220160:12345-0@lo:400:kworker.0 Request processed in 88us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919536.550796:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978219648:0@lo:400:kworker.0 00000100:00100000:1.0:1790919536.550807:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790919536.550819:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978220160:0@lo:400:kworker.0 00000100:00100000:1.0:1790919536.551550:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f283902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978220032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919536.556226:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978218880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14657us (15500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919536.556243:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790919536.556720:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978218880:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790919537.052623:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919538.080151:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919538.151627:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1790919538.151647:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1790919538.151654:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1790919538.153366:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1790919538.153390:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1790919538.153424:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f285ab6a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790919538.153430:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f38d52a000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f285ab6180 00000020:00080000:2.0:1790919538.153434:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f38d52a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f2863b0400 00000020:00080000:2.0:1790919538.153455:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1790919538.153462:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1790919538.153488:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1790919538.153716:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1790919538.153829:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919538.153844:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919538.153853:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919538.153860:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919538.153866:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919538.153896:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919538.153918:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919538.153922:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919538.153928:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919538.153935:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913f2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919539.103639:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919539.612396:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919539.612429:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978220544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919539.612506:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919539.612689:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220544 00000100:00100000:2.0:1790919539.612697:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220544 00000100:00100000:2.0:1790919539.612750:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790919539.612760:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978220544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919539.612803:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919539.612934:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978220544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919539.612943:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790919539.613100:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978220672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919539.613129:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919539.613297:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220672 00000100:00100000:0.0:1790919539.613303:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220672 00000100:00100000:0.0:1790919539.613337:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790919539.613344:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978220672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919539.613366:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919539.613423:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978220672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919539.613429:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790919539.613547:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978220672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919539.617554:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978220544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919539.656546:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656595:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656625:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656682:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656709:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656727:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656753:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919539.656783:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236032 00000100:00100000:3.0:1790919539.656792:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236032 00000100:00100000:3.0:1790919539.656838:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:3.0:1790919539.656847:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958236032:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.656914:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958236032:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.656921:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:3.0:1790919539.656952:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236160 00000100:00100000:3.0:1790919539.656956:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236160 00000100:00100000:3.0:1790919539.656989:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236672 00000100:00100000:3.0:1790919539.656992:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236672 00000100:00100000:3.0:1790919539.657007:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236288 00000100:00100000:3.0:1790919539.657010:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236288 00000100:00100000:3.0:1790919539.657020:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236800 00000100:00100000:3.0:1790919539.657022:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236800 00000100:00100000:3.0:1790919539.657036:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 259 00000100:00100000:3.0:1790919539.657041:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2412:x1877914958236160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.657103:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2412:x1877914958236160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 61us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.657109:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 259 00000100:00100000:3.0:1790919539.657122:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:3.0:1790919539.657127:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958236672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.657151:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958236672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.657164:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:3.0:1790919539.657177:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:3.0:1790919539.657183:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958236288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.657209:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958236288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.657215:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:3.0:1790919539.657226:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 262 00000100:00100000:3.0:1790919539.657231:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958236800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.657255:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958236800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.657261:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 262 00000100:00100000:3.0:1790919539.657281:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236416 00000100:00100000:3.0:1790919539.657284:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236416 00000100:00100000:3.0:1790919539.657305:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236544 00000100:00100000:3.0:1790919539.657308:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236544 00000100:00100000:3.0:1790919539.657324:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:3.0:1790919539.657330:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283903100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958236416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.657354:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283903100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2412:x1877914958236416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.657360:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:3.0:1790919539.657371:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:3.0:1790919539.657378:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958236544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919539.657413:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958236544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919539.657425:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00080000:3.0:1790919539.657560:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919539.657564:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919539.657566:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919539.657568:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790919540.125013:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919540.128075:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978220800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919540.128103:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919540.128116:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978220928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919540.128146:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919540.128235:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220800 00000100:00100000:3.0:1790919540.128243:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220800 00000100:00100000:3.0:1790919540.128289:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790919540.128289:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919540.128298:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978220800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919540.128330:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919540.128340:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978220928 00000100:00100000:2.0:1790919540.128344:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978220928 00000100:00100000:2.0:1790919540.128362:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790919540.128368:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978220928:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790919540.128433:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790919540.129826:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919540.129907:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978220928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1537us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919540.129916:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790919540.130184:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978220928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919540.136281:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978220800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7974us (8124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919540.136295:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790919540.140786:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1790919540.140799:0:3459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f39122c700, transno 4294967311 00000004:00080000:1.0:1790919540.140824:0:3459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1790919540.140865:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978220800:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790919540.252252:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919540.252261:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919540.252302:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790919540.252309:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790919540.446045:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919541.148409:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919541.350275:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919541.351124:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958236928 00000100:00100000:3.0:1790919541.351136:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958236928 00000100:00100000:3.0:1790919541.351226:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:3.0:1790919541.351236:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11196:x1877914958236928:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790919541.351343:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11196:x1877914958236928:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 108us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919541.351350:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00080000:0.0:1790919541.352367:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919541.356039:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919541.356152:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237056 00000100:00100000:1.0:1790919541.356168:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237056 00000100:00100000:1.0:1790919541.356247:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:1.0:1790919541.356259:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:11196:x1877914958237056:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790919541.356367:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:11196:x1877914958237056:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919541.356400:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00080000:0.0:1790919541.357546:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919541.368506:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919541.369662:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237312 00000100:00100000:1.0:1790919541.369684:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237312 00000100:00100000:1.0:1790919541.369783:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790919541.369801:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:11196:x1877914958237312:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790919541.370374:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:11196:x1877914958237312:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 572us (1880us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790919541.370384:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1790919541.660499:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978221440:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.660584:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919541.660676:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790919541.660683:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978221056:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.660714:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919541.660739:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978221568:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.660765:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919541.660821:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221056 00000100:00100000:3.0:1790919541.660829:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221056 00000100:00100000:3.0:1790919541.660871:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1790919541.660889:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978221056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.660939:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978221056:12345-0@lo:400:kworker.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919541.660947:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1790919541.660979:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221568 00000100:00100000:3.0:1790919541.660983:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221568 00000100:00100000:3.0:1790919541.661019:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790919541.661028:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978221568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.661104:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978221568:12345-0@lo:400:kworker.0 Request processed in 76us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919541.661110:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790919541.661171:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978221056:0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.661171:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919541.661196:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978221952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919541.661197:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978221568:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.661266:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221440 00000100:00100000:3.0:1790919541.661271:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221440 00000100:00100000:1.0:1790919541.661295:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919541.661308:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790919541.661319:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aecdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978221440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.661359:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221952 00000100:00100000:1.0:1790919541.661368:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221952 00000100:00100000:3.0:1790919541.661378:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aecdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978221440:12345-0@lo:400:kworker.0 Request processed in 61us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919541.661407:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790919541.661451:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978221440:0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.661455:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790919541.661473:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978221952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919541.661517:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919541.661583:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978221952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919541.661594:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1790919541.661629:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919541.661956:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978221312:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.661997:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919541.662021:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978221824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919541.662118:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919541.662309:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221312 00000100:00100000:1.0:1790919541.662316:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978221952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919541.662319:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221312 00000100:00100000:0.0:1790919541.662365:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790919541.662379:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978221312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.662468:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978221312:12345-0@lo:400:kworker.0 Request processed in 91us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919541.662476:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790919541.662611:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978222080:0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.662662:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919541.662703:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222080 00000100:00100000:1.0:1790919541.662743:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222080 00000100:00100000:1.0:1790919541.662821:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790919541.662828:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978222080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.662875:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978222080:12345-0@lo:400:kworker.0 Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919541.662882:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1790919541.662904:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790919541.663015:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fce00 x1877914978222080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919541.663028:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978222080:0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.663084:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978221184:0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.663115:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221824 00000100:00100000:1.0:1790919541.663120:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221824 00000100:00100000:2.0:1790919541.663126:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919541.663159:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978221696:0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.663163:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790919541.663174:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978221824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919541.663192:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919541.663198:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919541.663240:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978221824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919541.663243:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221184 00000100:00100000:2.0:1790919541.663249:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221184 00000100:00100000:1.0:1790919541.663251:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1790919541.663275:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919541.663278:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978221312:0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.663289:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978221696 00000100:00100000:2.0:1790919541.663296:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978221696 00000100:00100000:1.0:1790919541.663314:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790919541.663324:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978221824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919541.663333:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978221184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.663342:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790919541.663354:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978221696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790919541.663409:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919541.663416:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978221184:12345-0@lo:400:kworker.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919541.663426:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978221696:12345-0@lo:400:kworker.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919541.663426:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790919541.663439:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790919541.663493:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978221184:0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.663509:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978221696:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.663838:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919541.663949:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978222336:0@lo:400:kworker.0 00000100:00100000:3.0:1790919541.664004:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919541.664042:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978222208:0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.664222:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978222464:0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.664269:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919541.664300:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919541.664305:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978222592:0@lo:400:kworker.0 00000100:00100000:2.0:1790919541.664325:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919541.664354:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222464 00000100:00100000:2.0:1790919541.664360:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222464 00000100:00080000:0.0:1790919541.664751:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919541.664767:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222592 00000100:00100000:0.0:1790919541.664774:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222592 00000100:00100000:3.0:1790919541.664852:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919541.665608:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790919541.665626:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978222464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.665675:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790919541.665691:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978222592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.665761:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978222592:12345-0@lo:400:kworker.0 Request processed in 76us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919541.665768:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1790919541.665788:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790919541.665872:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fd500 x1877914978222592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919541.665895:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978222592:0@lo:400:kworker.0 00000100:00100000:1.0:1790919541.666093:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222336 00000100:00100000:1.0:1790919541.666103:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222336 00000100:00100000:1.0:1790919541.666201:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222208 00000100:00100000:1.0:1790919541.666225:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222208 00000100:00100000:2.0:1790919541.666327:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978222464:12345-0@lo:400:kworker.0 Request processed in 706us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919541.666338:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790919541.666376:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978222464:0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.669748:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790919541.669784:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978222336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.669936:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978222336:12345-0@lo:400:kworker.0 Request processed in 161us (5921us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919541.669945:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790919541.669979:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790919541.669988:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978222208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.670038:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978222208:12345-0@lo:400:kworker.0 Request processed in 52us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919541.670048:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978222336:0@lo:400:kworker.0 00000100:00100000:0.0:1790919541.670050:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790919541.670207:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978222208:0@lo:400:kworker.0 00010000:00010000:3.0:1790919542.175482:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919543.199552:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790919543.260004:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1790919543.260023:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1790919543.260042:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1790919543.260075:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1790919543.370547:0:14031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:39:02 (1790919542) 00010000:00010000:2.0:1790919544.222327:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919544.732792:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919544.732816:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978222720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919544.732886:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919544.733186:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919544.733210:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978222848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919544.733242:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919544.733506:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222720 00000100:00100000:0.0:1790919544.733515:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222720 00000100:00100000:0.0:1790919544.733564:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222848 00000100:00100000:0.0:1790919544.733568:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222848 00000100:00100000:0.0:1790919544.733595:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790919544.733604:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978222720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919544.733642:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919544.733689:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978222720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919544.733696:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790919544.733713:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790919544.733720:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f381326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978222848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919544.733737:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919544.733781:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f381326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978222848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919544.733787:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790919544.733926:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978222720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919544.734049:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978222848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919544.782014:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782084:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782130:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782158:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782178:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782194:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782247:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919544.782273:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237696 00000100:00100000:2.0:1790919544.782282:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237696 00000100:00100000:1.0:1790919544.782331:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238208 00000100:00100000:2.0:1790919544.782333:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237568 00000100:00100000:2.0:1790919544.782338:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237568 00000100:00100000:1.0:1790919544.782339:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238208 00000100:00100000:2.0:1790919544.782362:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238080 00000100:00100000:2.0:1790919544.782377:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238080 00000100:00100000:1.0:1790919544.782389:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 269 00000100:00100000:1.0:1790919544.782404:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958237696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919544.782407:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 270 00000100:00100000:2.0:1790919544.782420:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2413:x1877914958237568:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919544.782500:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237440 00000100:00100000:3.0:1790919544.782505:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237440 00000100:00100000:3.0:1790919544.782531:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 377 00000100:00100000:3.0:1790919544.782538:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958237440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919544.782593:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2413:x1877914958237568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 174us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919544.782601:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 270 00000100:00100000:2.0:1790919544.782618:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:2.0:1790919544.782624:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958238208:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919544.782689:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237952 00000100:00100000:0.0:1790919544.782694:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237952 00000100:00100000:0.0:1790919544.782723:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958237824 00000100:00100000:0.0:1790919544.782726:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958237824 00000100:00100000:0.0:1790919544.782747:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:0.0:1790919544.782753:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958237952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919544.785432:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958237440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 2880us (3413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919544.785432:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958237696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3019us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919544.785454:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 377 00000100:00100000:1.0:1790919544.785454:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 269 00000100:00100000:1.0:1790919544.785500:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:1.0:1790919544.785514:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aedab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958238080:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919544.785564:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958238080:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 57us (3317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919544.785571:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:1.0:1790919544.785599:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790919544.785609:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958237824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:3.0:1790919544.785715:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919544.785720:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919544.785723:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919544.785726:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919544.788685:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958237824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3066us (6476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919544.788700:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:2.0:1790919544.790577:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958238208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7940us (8404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919544.790592:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:0.0:1790919544.794024:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aedab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958237952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 11258us (11881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919544.794039:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:3.0:1790919544.825389:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919544.826176:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238464 00000100:00100000:0.0:1790919544.826188:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238464 00000100:00100000:0.0:1790919544.826255:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:0.0:1790919544.826266:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:12263:x1877914958238464:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919544.826288:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919544.826326:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913fba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38dc8 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826409:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826425:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826436:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826461:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826468:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826474:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826805:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913fcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826815:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919544.826822:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913fcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919544.826832:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790919544.828599:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828615:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828634:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828642:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919544.828647:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828680:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828695:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919544.828698:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919544.828703:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828708:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15913fc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828724:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828730:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828736:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828741:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919544.828743:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828749:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828755:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95f382b81500) 00010000:00010000:2.0:1790919544.828757:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919544.828759:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.828775:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15913fc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.829486:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15913fba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dc8 expref: 16 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.829505:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913fcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dc8 expref: 15 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919544.829512:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919544.829515:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919544.829518:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:2.0:1790919544.829588:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:12263:x1877914958238464:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3323us (4207us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1790919544.829597:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:3.0:1790919544.837010:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919544.837524:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238592 00000100:00100000:1.0:1790919544.837535:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238592 00000100:00100000:1.0:1790919544.837605:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:1.0:1790919544.837628:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:12263:x1877914958238592:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790919544.837743:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:12263:x1877914958238592:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 116us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919544.837750:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:3.0:1790919544.839464:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919544.839923:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238720 00000100:00100000:1.0:1790919544.839933:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238720 00000100:00100000:1.0:1790919544.839998:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919544.840008:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:2412:x1877914958238720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919544.840024:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919544.840093:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15913fcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dc8 expref: 15 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919544.840113:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:1.0:1790919544.840119:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919544.840179:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:2412:x1877914958238720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 172us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919544.840187:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1790919544.845479:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919544.845578:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238848 00000100:00100000:3.0:1790919544.845589:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238848 00000100:00100000:3.0:1790919544.845695:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:3.0:1790919544.845706:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:12263:x1877914958238848:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790919544.845821:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:12263:x1877914958238848:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 116us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919544.845828:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:0.0:1790919545.244267:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919545.244940:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978222976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919545.245022:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919545.246101:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978222976 00000100:00100000:1.0:1790919545.246112:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978222976 00000100:00100000:1.0:1790919545.246171:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790919545.246183:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978222976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919545.246227:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919545.246310:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978222976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919545.246317:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1790919545.246422:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919545.246481:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978223104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919545.246521:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919545.246582:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978222976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919545.246787:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223104 00000100:00100000:0.0:1790919545.246793:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223104 00000100:00100000:0.0:1790919545.246832:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919545.246840:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978223104:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790919545.246861:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1790919545.247300:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919545.247371:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978223104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 523us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919545.247381:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790919545.248017:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978223104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790919545.252422:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919545.372322:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919545.372332:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919545.372923:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790919545.372933:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790919545.567292:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790919546.271462:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919546.694339:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919546.698273:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958238976 00000100:00100000:1.0:1790919546.698287:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958238976 00000100:00100000:1.0:1790919546.698417:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:1.0:1790919546.698428:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:12305:x1877914958238976:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919546.698449:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919546.698468:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38dcf expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698534:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698549:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698560:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698574:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698581:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698588:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698781:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698789:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698796:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698802:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919546.698807:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698815:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698826:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:1.0:1790919546.698829:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919546.698835:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698852:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15913fe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698866:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698872:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698878:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698890:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919546.698894:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698900:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698908:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95f392142400) 00010000:00010000:1.0:1790919546.698911:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919546.698913:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698920:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913feb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698952:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913fdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dcf expref: 15 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698962:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:1.0:1790919546.698965:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919546.698969:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dcf expref: 15 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.698979:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d800, rc 0) 00000100:00100000:1.0:1790919546.699044:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:12305:x1877914958238976:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 618us (4714us total) trans 0 rc 301/301 00000100:00100000:1.0:1790919546.699078:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00080000:3.0:1790919546.702215:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919546.709994:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919546.710371:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958239232 00000100:00100000:1.0:1790919546.710388:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958239232 00000100:00100000:1.0:1790919546.710449:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:1.0:1790919546.710460:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:12305:x1877914958239232:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:1.0:1790919546.710519:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919546.710546:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2cc00/0x951c50ad15913969 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c0f expref: 14 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.710569:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5900) 00010000:00010000:1.0:1790919546.710584:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919546.710811:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.710825:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.710834:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.710858:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.710865:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.710871:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711706:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711718:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711732:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919546.711746:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001031d11b reply state 00000000927cc5e2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711755:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711762:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919546.711764:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919546.711767:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790919546.711772:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790919546.711778:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711785:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711791:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711797:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919546.711802:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711809:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711817:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142400) 00010000:00010000:1.0:1790919546.711819:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919546.711829:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711834:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15913ff2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919546.711849:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001031d11b reply state 00000000927cc5e2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711857:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.711863:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95f392142c00) 00010000:00010000:1.0:1790919546.711866:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919546.711868:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790919546.711956:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:12305:x1877914958239232:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1495us (1967us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790919546.711964:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:0.0:1790919546.780288:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978223488:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780364:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780415:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978224000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780444:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780464:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978224512:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780486:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780519:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790919546.780526:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978223616:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780550:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780569:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978224128:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780592:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780607:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978224640:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780626:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780657:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223488 00000100:00100000:0.0:1790919546.780678:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223488 00000100:00100000:0.0:1790919546.780716:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223616 00000100:00100000:0.0:1790919546.780719:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223616 00000100:00100000:0.0:1790919546.780732:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790919546.780740:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978223488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919546.780776:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978223360:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780811:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978223488:12345-0@lo:400:kworker.0 Request processed in 70us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.780822:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790919546.780823:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780844:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790919546.780851:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978223872:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780855:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978223616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919546.780879:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780895:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978223616:12345-0@lo:400:kworker.0 Request processed in 42us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919546.780904:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978224384:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780904:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790919546.780925:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224000 00000100:00100000:0.0:1790919546.780930:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224000 00000100:00100000:2.0:1790919546.780935:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.780965:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224512 00000100:00100000:2.0:1790919546.780969:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790919546.780969:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224512 00000100:00100000:2.0:1790919546.780979:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978223232:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.780986:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223360 00000100:00100000:0.0:1790919546.780990:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223360 00000100:00100000:0.0:1790919546.781004:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223872 00000100:00100000:0.0:1790919546.781006:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223872 00000100:00100000:0.0:1790919546.781021:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224384 00000100:00100000:0.0:1790919546.781024:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224384 00000100:00100000:2.0:1790919546.781032:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.781043:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790919546.781083:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978224000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919546.781084:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978223744:0@lo:400:kworker.0 00000100:00100000:2.0:1790919546.781123:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919546.781138:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978224256:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781144:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978224000:12345-0@lo:400:kworker.0 Request processed in 92us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781153:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1790919546.781166:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.781167:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223744 00000100:00100000:0.0:1790919546.781176:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223744 00000100:00100000:2.0:1790919546.781184:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b59a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978224768:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781198:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790919546.781206:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978224512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919546.781213:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919546.781251:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978223232 00000100:00100000:0.0:1790919546.781252:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978224512:12345-0@lo:400:kworker.0 Request processed in 47us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919546.781256:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978223232 00000100:00100000:0.0:1790919546.781262:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790919546.781279:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790919546.781286:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978223360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919546.781293:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1790919546.781304:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978223232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781325:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978223360:12345-0@lo:400:kworker.0 Request processed in 38us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781332:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790919546.781347:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978223232:12345-0@lo:400:kworker.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781361:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1790919546.781369:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1790919546.781374:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978223872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781410:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978223872:12345-0@lo:400:kworker.0 Request processed in 40us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781417:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790919546.781430:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790919546.781436:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978224384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781463:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978224384:12345-0@lo:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781468:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790919546.781479:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790919546.781484:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781511:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978223744:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781526:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790919546.781549:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224128 00000100:00100000:0.0:1790919546.781553:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224128 00000100:00100000:0.0:1790919546.781576:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224640 00000100:00100000:0.0:1790919546.781579:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224640 00000100:00100000:0.0:1790919546.781593:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224256 00000100:00100000:0.0:1790919546.781596:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224256 00000100:00100000:0.0:1790919546.781609:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224768 00000100:00100000:0.0:1790919546.781612:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224768 00000100:00100000:0.0:1790919546.781624:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790919546.781630:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978224128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781666:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978224128:12345-0@lo:400:kworker.0 Request processed in 36us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781671:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790919546.781682:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919546.781688:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978224640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781715:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978224640:12345-0@lo:400:kworker.0 Request processed in 28us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781720:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790919546.781730:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919546.781736:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978224256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781762:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978224256:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781768:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790919546.781777:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919546.781783:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978224768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781824:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978224768:12345-0@lo:400:kworker.0 Request processed in 41us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.781831:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790919546.781873:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978223616:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781887:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978224128:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781896:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978224640:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.781905:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978223488:0@lo:400:kworker.0 00010000:00080000:0.0:1790919546.781915:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fc000 x1877914978224000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919546.781925:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978224000:0@lo:400:kworker.0 00010000:00080000:0.0:1790919546.781934:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fdf80 x1877914978224512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919546.781942:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978224512:0@lo:400:kworker.0 00000100:00080000:0.0:1790919546.781985:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919546.781989:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919546.781991:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919546.782012:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978223232:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.782024:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978223744:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.782033:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978224256:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.782041:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b59a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978224768:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.782073:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978223360:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.782097:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978223872:0@lo:400:kworker.0 00000100:00100000:0.0:1790919546.782107:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978224384:0@lo:400:kworker.0 00000100:00100000:1.0:1790919546.782986:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919546.782999:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978224896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919546.783047:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919546.783108:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978225024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919546.783711:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919546.783847:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978224896 00000100:00100000:0.0:1790919546.783856:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978224896 00000100:00100000:0.0:1790919546.783928:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978225024 00000100:00100000:0.0:1790919546.783932:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978225024 00000100:00100000:3.0:1790919546.785424:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790919546.785441:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978224896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919546.785481:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919546.785781:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978224896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 344us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919546.785791:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790919546.785808:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978224896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919546.785819:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790919546.785829:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978225024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919546.785841:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919546.785890:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978225024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919546.785897:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790919546.785922:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978225024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919546.806463:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919546.806577:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958239360 00000100:00100000:0.0:1790919546.806587:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958239360 00000100:00100000:0.0:1790919546.806655:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:0.0:1790919546.806664:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+15:12313:x1877914958239360:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:0.0:1790919546.806690:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919546.806713:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38dd6 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.806777:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591400e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.806790:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591400e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.806801:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591400e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919546.806835:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919546.806852:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919546.806875:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591400e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.806899:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dd6 expref: 17 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.806931:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591400e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dd6 expref: 16 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.806941:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:0.0:1790919546.806944:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919546.806947:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015a00, rc 0) 00000100:00100000:0.0:1790919546.807012:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:12313:x1877914958239360:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 348us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.807019:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:0.0:1790919546.839265:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919546.839385:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958239488 00000100:00100000:2.0:1790919546.839395:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958239488 00000100:00100000:2.0:1790919546.839455:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:2.0:1790919546.839465:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:12319:x1877914958239488:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919546.839486:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919546.839508:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ddd expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839594:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839608:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839618:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839631:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839638:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839644:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839730:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad1591402a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839739:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad1591402a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839746:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad1591402a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919546.839771:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790919546.839775:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919546.839795:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad1591402a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839818:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839825:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839831:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839836:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919546.839841:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839848:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839859:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:2.0:1790919546.839861:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919546.839865:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839871:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591401c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839885:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839890:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839896:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839907:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919546.839911:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839917:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839925:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95f392142c00) 00010000:00010000:2.0:1790919546.839928:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919546.839930:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839936:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914023 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839963:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ddd expref: 18 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839975:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad1591402a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ddd expref: 17 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919546.839982:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919546.839984:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919546.839987:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697200, rc 0) 00000100:00100000:2.0:1790919546.840099:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:12319:x1877914958239488:12345-192.168.203.11@tcp:101:bash.0 Request processed in 587us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919546.840107:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:2.0:1790919546.845706:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919546.845845:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958239744 00000100:00100000:1.0:1790919546.845856:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958239744 00000100:00100000:1.0:1790919546.845922:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1790919546.845937:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:12319:x1877914958239744:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919546.845956:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919546.845984:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914031 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38de4 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.846123:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.846152:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.846164:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.846210:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.846217:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919546.846223:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919546.846744:0:13325:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790919546.847494:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847507:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847516:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847549:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847556:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847562:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847567:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919546.847580:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847589:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847601:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919546.847604:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919546.847608:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847614:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914038 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919546.847629:0:13325:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004d2a48b7 reply state 00000000f299e009 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847639:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847646:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:0.0:1790919546.847649:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790919546.847651:0:13325:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790919546.847682:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914031 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 20 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847696:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 19 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.847703:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:0.0:1790919546.847705:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919546.847713:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015c00, rc 0) 00000100:00100000:0.0:1790919546.847895:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12319:x1877914958239744:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1963us (2197us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790919546.847904:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:1.0:1790919546.851713:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919546.851857:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958239872 00000100:00100000:0.0:1790919546.851867:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958239872 00000100:00100000:0.0:1790919546.851939:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1790919546.851948:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958239872:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919546.851965:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919546.851985:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38deb expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919546.852010:0:8248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919546.852033:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1790919546.852038:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919546.852048:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 6 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.852096:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 6 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.852110:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919546.852164:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958239872:12345-192.168.203.11@tcp:101:bash.0 Request processed in 216us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.852171:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00080000:3.0:1790919546.852652:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919546.856520:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919546.856603:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958240000 00000100:00100000:0.0:1790919546.856612:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958240000 00000100:00100000:0.0:1790919546.856683:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1790919546.856693:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:12319:x1877914958240000:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919546.856712:0:8084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919546.856729:0:8084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38df2 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.856768:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 7 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.856778:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919546.856782:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919546.856787:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.856818:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 7 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.856831:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 7 pid: 8248 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919546.856845:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978225152:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919546.856928:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919546.859609:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919546.859688:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958240128 00000100:00100000:3.0:1790919546.859696:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958240128 00010000:00010000:3.0:1790919546.859733:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 8 pid: 8248 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919546.859781:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1790919546.859790:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958240128:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919546.859804:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919546.859826:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 8 pid: 8248 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919546.859840:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 8 pid: 8248 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919546.859877:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919546.859882:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919546.859892:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919546.859901:0:6432:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919546.859940:0:6432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 8 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919546.859955:0:6432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6432:1877914978225280:192.168.203.11@tcp:105: 00000100:00100000:3.0:1790919546.860035:0:6432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798780 going to sleep for 11 seconds 00010000:00010000:0.0:1790919546.860677:0:8084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914054 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38deb expref: 8 pid: 8248 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919546.860694:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978225152:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919546.860727:0:8084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 7 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.860737:0:8084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015e00, rc 0) 00000100:00100000:0.0:1790919546.860794:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:12319:x1877914958240000:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4103us (4282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919546.860803:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1790919546.864515:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919546.864592:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958240384 00000100:00100000:1.0:1790919546.864601:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958240384 00000100:00100000:1.0:1790919546.864654:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1790919546.864664:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12319:x1877914958240384:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:3.0:1790919546.865104:0:6432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6432:1877914978225280:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790919546.865138:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919546.865196:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:12319:x1877914958240384:12345-192.168.203.11@tcp:35:bash.0 Request processed in 533us (689us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1790919546.865205:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:3.0:1790919546.865452:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398cc0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958240128:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5660us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919546.865461:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1790919546.932216:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919546.932456:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958240640 00000100:00100000:0.0:1790919546.932467:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958240640 00000100:00100000:0.0:1790919546.932525:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:0.0:1790919546.932534:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:12329:x1877914958240640:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919546.932559:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919546.932579:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38df9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919546.932669:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790919546.932855:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914062 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df9 expref: 23 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.932868:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:0.0:1790919546.932871:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919546.932876:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df9 expref: 23 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919546.932890:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919546.932953:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12329:x1877914958240640:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 420us (752us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1790919546.932977:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:0.0:1790919546.935786:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919546.935879:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958240896 00000100:00100000:1.0:1790919546.935891:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958240896 00000100:00100000:1.0:1790919546.935953:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790919546.935966:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12329:x1877914958240896:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919546.936428:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12329:x1877914958240896:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 462us (650us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1790919546.936437:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:2.0:1790919547.050184:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.050264:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958241024 00000100:00100000:0.0:1790919547.050273:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958241024 00000100:00100000:0.0:1790919547.050328:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1790919547.050337:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12335:x1877914958241024:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919547.050373:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919547.050397:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e00 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.050465:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914077 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.050481:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.050494:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919547.050533:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790919547.050538:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919547.050556:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.050581:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e00 expref: 25 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.050598:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e00 expref: 24 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.050638:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919547.050642:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919547.050645:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015600, rc 0) 00000100:00100000:0.0:1790919547.050704:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12335:x1877914958241024:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 367us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919547.050712:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:3.0:1790919547.060219:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919547.060338:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958241280 00000100:00100000:2.0:1790919547.060359:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958241280 00000100:00100000:2.0:1790919547.060435:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:2.0:1790919547.060445:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12335:x1877914958241280:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919547.060466:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919547.060486:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591407e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e07 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.060588:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914085 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.060603:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.060614:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919547.060754:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790919547.060999:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591407e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e07 expref: 27 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.061018:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914085 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e07 expref: 26 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.061026:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:2.0:1790919547.061029:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919547.061044:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697800, rc 0) 00000100:00100000:2.0:1790919547.061235:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:12335:x1877914958241280:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 791us (1024us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1790919547.061242:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:2.0:1790919547.069866:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.070021:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958241536 00000100:00100000:3.0:1790919547.070031:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958241536 00000100:00100000:3.0:1790919547.070110:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1790919547.070120:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:12335:x1877914958241536:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919547.070155:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919547.070176:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15914093 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e0e expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.070266:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591409a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.070281:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591409a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.070292:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591409a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919547.070303:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790919547.070432:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15914093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e0e expref: 29 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.070449:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591409a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e0e expref: 28 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.070458:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:3.0:1790919547.070461:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790919547.070464:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c200, rc 0) 00000100:00100000:3.0:1790919547.070519:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:12335:x1877914958241536:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 400us (661us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1790919547.070526:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1790919547.072398:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.072472:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958241664 00000100:00100000:0.0:1790919547.072482:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958241664 00000100:00100000:0.0:1790919547.072542:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790919547.072552:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:2412:x1877914958241664:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919547.072566:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919547.072588:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914085 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e07 expref: 28 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.072606:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:0.0:1790919547.072610:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919547.079102:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:2412:x1877914958241664:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6538us (6697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919547.079120:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790919547.082089:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.082396:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958241792 00000100:00100000:0.0:1790919547.082407:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958241792 00000100:00100000:0.0:1790919547.082462:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1790919547.082472:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958241792:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:0.0:1790919547.082517:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.082556:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 6 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.082565:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790919547.082570:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919547.082575:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.082613:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 6 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.082641:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 6 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919547.082658:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8248:1877914978225408:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919547.082732:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919547.093323:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.093427:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8248:1877914978225408:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919547.093452:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919547.093538:0:8089:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958241920 00000100:00100000:1.0:1790919547.093547:0:8089:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958241920 00002000:00100000:1.0:1790919547.093592:0:8089:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff95f286813b80 x1877914958241920/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:668/0 lens 504/0 e 0 to 0 dl 1790919558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919547.093601:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f286813b80 with x1877914958241920 ext(0->12) 00010000:00010000:1.0:1790919547.093609:0:8089:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 7 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.093624:0:8089:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 7 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919547.093632:0:8089:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f286813b80 00000100:00100000:1.0:1790919547.093946:0:8089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1790919547.093958:0:8089:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958241920:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:1.0:1790919547.094647:0:8089:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958241920:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 689us (1329us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790919547.094656:0:8089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:1.0:1790919547.094666:0:8089:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff95f286813b80 x1877914958241920/t4294967306(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:668/0 lens 504/448 e 0 to 0 dl 1790919558 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790919547.094686:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f286813b80 with x1877914958241920 ext(0->12) 00010000:00010000:1.0:1790919547.094695:0:8089:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 9 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.094708:0:8089:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 9 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790919547.094713:0:8089:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f286813b80 00000100:00100000:2.0:1790919547.098536:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919547.098633:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958242048 00000100:00100000:1.0:1790919547.098647:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958242048 00010000:00010000:1.0:1790919547.098689:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 9 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919547.098782:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:1.0:1790919547.098792:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2412:x1877914958242048:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919547.098808:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790919547.098825:0:12731:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790919547.098828:0:12731:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790919547 00002000:00010000:1.0:1790919547.098830:0:12731:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790919547 00002000:00010000:1.0:1790919547.098832:0:12731:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790919547 00010000:00010000:1.0:1790919547.098839:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 9 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.098853:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 9 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.098898:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6270ba6/0x951c50ad1591405b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38df2 expref: 9 pid: 8084 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.098915:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919547.098919:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919547.098925:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.098936:0:12731:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.098967:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919547.099022:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2412:x1877914958242048:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 231us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919547.099030:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00010000:00010000:3.0:1790919547.099212:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099223:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099247:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099256:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099264:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099271:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919547.099275:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099284:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099343:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.099362:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad159140a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919547.099434:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958241792:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 16963us (17354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919547.099443:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790919547.103235:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919547.103328:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958242304 00000100:00100000:1.0:1790919547.103339:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958242304 00000100:00100000:1.0:1790919547.103405:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1790919547.103414:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390320c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12335:x1877914958242304:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:1.0:1790919547.103477:0:6449:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591409a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e0e expref: 27 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919547.103721:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1790919547.103765:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790919547.104392:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1790919547.104448:0:6449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.104476:0:6449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 31 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.104486:0:6449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.104523:0:6449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 31 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.104537:0:6449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 31 pid: 13325 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919547.104551:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6449:1877914978225536:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919547.104758:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919547.109737:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6449:1877914978225536:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919547.109769:0:6449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919547.110366:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.110894:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958242432 00000100:00100000:3.0:1790919547.110903:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958242432 00010000:00010000:3.0:1790919547.110940:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 32 pid: 13325 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919547.111027:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:3.0:1790919547.111036:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:2413:x1877914958242432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919547.111070:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919547.111077:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 32 pid: 13325 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.111100:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 32 pid: 13325 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.111122:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914046 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38de4 expref: 32 pid: 13325 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.111139:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:3.0:1790919547.111144:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.111154:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.111190:0:13233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.111225:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919547.111287:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+31:2413:x1877914958242432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 251us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919547.111294:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00010000:00010000:1.0:1790919547.111365:0:6449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.111375:0:6449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919547.111496:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1790919547.111680:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1790919547.111779:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978225664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790919547.111841:0:6449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919547.111879:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f86e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919547.111945:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978225664 00000100:00100000:2.0:1790919547.111951:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978225664 00000100:00100000:2.0:1790919547.111990:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790919547.111998:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6449:x1877914978225664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790919547.112087:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6449:x1877914978225664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919547.112095:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790919547.112178:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978225664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790919547.112658:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1790919547.112713:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978225792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790919547.112743:0:6449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919547.112767:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284c00a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919547.112813:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978225792 00000100:00100000:0.0:1790919547.112819:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978225792 00000100:00100000:0.0:1790919547.112853:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790919547.112862:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6449:x1877914978225792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919547.113030:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6449:x1877914978225792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 169us (284us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790919547.113038:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790919547.113226:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978225792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790919547.113270:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1790919547.113303:0:6449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.113313:0:6449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.113321:0:6449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.113327:0:6449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919547.113332:0:6449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.113340:0:6449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.113362:0:6449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:1.0:1790919547.113366:0:6449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790919547.113674:0:6449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.113693:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159140af lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919547.114069:0:6449:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790919547.114382:0:6449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1790919547.114467:0:6449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356142413583ns, next at 357142410943ns, rc = 0 00000001:00080000:1.0:1790919547.114475:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1790919547.114527:0:6449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81700) 00010000:00010000:1.0:1790919547.114530:0:6449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790919547.114539:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591409a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e0e expref: 35 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919547.114666:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390320c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:12335:x1877914958242304:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 11252us (11449us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1790919547.114674:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000020:00080000:1.0:1790919547.114679:0:6449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790919547.116909:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.118375:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958242560 00000100:00100000:0.0:1790919547.118398:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958242560 00000100:00100000:0.0:1790919547.118459:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:0.0:1790919547.118469:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:12335:x1877914958242560:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919547.118500:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919547.118523:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159140b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e15 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.118583:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159140b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e15 expref: 35 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.118598:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159140b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e15 expref: 35 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.118617:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:0.0:1790919547.118621:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919547.118624:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014e00, rc 0) 00000100:00100000:0.0:1790919547.118689:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:12335:x1877914958242560:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 221us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919547.118696:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:2.0:1790919547.124102:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.124339:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958242816 00000100:00100000:0.0:1790919547.124362:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958242816 00000100:00100000:0.0:1790919547.124421:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790919547.124430:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+35:12335:x1877914958242816:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790919547.124679:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:12335:x1877914958242816:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 249us (584us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1790919547.124687:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790919547.190586:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.190704:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958243072 00000100:00100000:0.0:1790919547.190715:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958243072 00000100:00100000:0.0:1790919547.190775:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:0.0:1790919547.190785:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:12345:x1877914958243072:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919547.190809:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919547.190829:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159140bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e1c expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919547.190917:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790919547.191032:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159140bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e1c expref: 38 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.191047:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:0.0:1790919547.191090:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919547.191097:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159140bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e1c expref: 38 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.191111:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015c00, rc 0) 00000100:00100000:0.0:1790919547.191176:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:12345:x1877914958243072:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 393us (606us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1790919547.191185:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:2.0:1790919547.194213:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.194474:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958243200 00000100:00100000:3.0:1790919547.194484:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958243200 00000100:00100000:3.0:1790919547.194542:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:3.0:1790919547.194554:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:12345:x1877914958243200:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1790919547.194626:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194644:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194655:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194666:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194673:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194680:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194765:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194786:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194794:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919547.194836:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194849:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194856:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194863:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194868:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919547.194871:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194880:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194890:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919547.194893:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919547.194897:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194903:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194922:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194928:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194934:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194939:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919547.194942:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194949:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194957:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:3.0:1790919547.194959:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919547.194962:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194968:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194977:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194983:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194988:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.194999:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919547.195002:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.195007:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.195014:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919547.195017:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919547.195020:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.195025:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919547.195150:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:12345:x1877914958243200:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 598us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919547.195159:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:2.0:1790919547.197267:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919547.197423:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958243456 00000100:00100000:1.0:1790919547.197433:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958243456 00000100:00100000:1.0:1790919547.197488:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1790919547.197499:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:12345:x1877914958243456:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919547.197711:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:12345:x1877914958243456:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 213us (461us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790919547.197719:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919547.240121:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919547.242029:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958243712 00000100:00100000:2.0:1790919547.242044:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958243712 00000100:00100000:3.0:1790919547.243433:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1790919547.243446:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:12348:x1877914958243712:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919547.243472:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919547.243492:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159140e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e23 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243573:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243589:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243614:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243626:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243644:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243652:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243760:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243770:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243778:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919547.243787:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790919547.243886:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243895:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243902:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243909:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919547.243918:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243927:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243939:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919547.243943:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919547.243947:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243954:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159140e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243968:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243975:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243981:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.243986:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919547.243989:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.244006:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.244014:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:3.0:1790919547.244017:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919547.244026:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.244033:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159140ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.245721:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159140e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 41 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.245751:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 40 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.245759:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919547.245761:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919547.245764:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d800, rc 0) 00000100:00100000:3.0:1790919547.245852:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+40:12348:x1877914958243712:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2408us (5739us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790919547.245862:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1790919547.252836:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.255673:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958243840 00000100:00100000:0.0:1790919547.255699:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958243840 00000100:00100000:0.0:1790919547.255760:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:0.0:1790919547.255772:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f286810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+40:12348:x1877914958243840:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790919547.256140:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256159:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256172:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256198:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256206:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256214:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256221:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919547.256225:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256233:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256243:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:0.0:1790919547.256247:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919547.256251:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.256270:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914103 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919547.256411:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f286810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+40:12348:x1877914958243840:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 640us (3583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919547.256419:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:2.0:1790919547.264421:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919547.264651:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958244096 00000100:00100000:1.0:1790919547.264662:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958244096 00000100:00100000:1.0:1790919547.264746:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1790919547.264756:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+40:12348:x1877914958244096:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919547.265014:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+41:12348:x1877914958244096:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 258us (601us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1790919547.265022:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00010000:00010000:2.0:1790919547.293608:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919547.513320:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.513387:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958244352 00000100:00100000:3.0:1790919547.513398:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958244352 00000100:00100000:3.0:1790919547.513463:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1790919547.513472:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+41:12379:x1877914958244352:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1790919547.513498:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919547.513517:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591410a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e2a expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.513618:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.513652:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.513663:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919547.513676:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790919547.513799:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591410a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e2a expref: 44 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.513818:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e2a expref: 43 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.513827:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919547.513830:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919547.513833:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166de00, rc 0) 00000100:00100000:3.0:1790919547.514002:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:12379:x1877914958244352:12345-192.168.203.11@tcp:101:cat.0 Request processed in 530us (689us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1790919547.514009:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1790919547.526661:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.526705:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919547.526799:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958244736 00000100:00100000:2.0:1790919547.526808:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958244736 00000100:00100000:2.0:1790919547.526870:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790919547.526880:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:12379:x1877914958244736:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:2.0:1790919547.527164:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:12379:x1877914958244736:12345-192.168.203.11@tcp:35:cat.0 Request processed in 284us (457us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1790919547.527173:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790919547.527571:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958244480 00000100:00100000:1.0:1790919547.527576:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958244480 00000100:00100000:1.0:1790919547.527625:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790919547.527633:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:2411:x1877914958244480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919547.527645:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919547.527667:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e2a expref: 44 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.527687:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919547.527691:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919547.527715:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:2411:x1877914958244480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 83us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919547.527721:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919547.595614:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.595724:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958244992 00000100:00100000:3.0:1790919547.595734:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958244992 00000100:00100000:3.0:1790919547.595794:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:3.0:1790919547.595803:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:12385:x1877914958244992:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790919547.595827:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919547.595830:0:6446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790919547.595878:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914077 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e00 expref: 43 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.595899:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919547.595904:0:6446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919547.595917:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591411f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e31 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.596010:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.596024:0:6446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 43 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.596034:0:6446:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.596161:0:6446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 43 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.596174:0:6446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 43 pid: 6445 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919547.596186:0:6446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6446:1877914978225920:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919547.596264:0:6446:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919547.600470:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.600632:0:6446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6446:1877914978225920:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919547.600660:0:6446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919547.600996:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958245120 00000100:00100000:1.0:1790919547.601005:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958245120 00010000:00010000:1.0:1790919547.601042:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 44 pid: 6445 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919547.601111:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1790919547.601120:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:2413:x1877914958245120:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919547.601133:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919547.601140:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 44 pid: 6445 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.601165:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 44 pid: 6445 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.601187:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159140f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e23 expref: 44 pid: 6445 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.601204:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919547.601209:0:6431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.601218:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.601226:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.601250:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919547.601306:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:2413:x1877914958245120:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 187us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919547.601315:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00010000:00010000:3.0:1790919547.601540:0:6446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.601549:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919547.601569:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790919547.601718:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591411f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 45 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.601733:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 44 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.601741:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919547.601755:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790919547.601757:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:3.0:1790919547.601786:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:12385:x1877914958244992:12345-192.168.203.11@tcp:101:dd.0 Request processed in 5984us (6182us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1790919547.601793:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:2.0:1790919547.604655:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919547.604985:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958245376 00000100:00100000:1.0:1790919547.604994:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958245376 00000100:00100000:1.0:1790919547.605122:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:1.0:1790919547.605298:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:12385:x1877914958245376:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:1.0:1790919547.605672:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.605688:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.605714:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919547.605780:0:10757:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1790919547.605803:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009fcc8658 reply state 00000000322a50f3 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.605815:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919547.605821:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919547.605823:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919547.605827:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919547.605960:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+46:12385:x1877914958245376:12345-192.168.203.11@tcp:36:dd.0 Request processed in 666us (1313us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1790919547.605968:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00000020:00080000:1.0:1790919547.605973:0:10757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919547.835357:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919547.835556:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958245504 00000100:00100000:2.0:1790919547.835567:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958245504 00000100:00100000:2.0:1790919547.835628:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:2.0:1790919547.835763:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+46:12399:x1877914958245504:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:2.0:1790919547.835788:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919547.835808:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591413b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e38 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.835873:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.835886:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.835896:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.835906:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.835913:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.835919:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.836018:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.836029:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 47 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.836037:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.836092:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 47 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.836108:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 47 pid: 6446 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919547.836125:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978226048:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919547.836222:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919547.841671:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978226048:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919547.841822:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919547.849476:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919547.849678:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958245760 00000100:00100000:1.0:1790919547.849691:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958245760 00000100:00100000:1.0:1790919547.849750:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1790919547.849760:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+48:10893:x1877914958245760:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790919547.850101:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+49:10893:x1877914958245760:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 341us (902us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1790919547.850109:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1790919547.860218:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919547.860326:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958245888 00000100:00100000:0.0:1790919547.860337:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958245888 00010000:00010000:0.0:1790919547.860387:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 49 pid: 6446 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919547.860440:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:0.0:1790919547.860449:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+49:2413:x1877914958245888:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919547.860463:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919547.860470:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 49 pid: 6446 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.860483:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 49 pid: 6446 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.860520:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914126 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e31 expref: 49 pid: 6446 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.860537:0:6432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:0.0:1790919547.860542:0:6432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.860552:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.860558:0:6432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919547.860590:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919547.860658:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+48:2413:x1877914958245888:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 208us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919547.860668:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00010000:00010000:2.0:1790919547.860792:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860801:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919547.860849:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790919547.860854:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919547.860876:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860900:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860910:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860917:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860923:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860929:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919547.860933:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860941:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860950:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919547.860953:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919547.860957:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860962:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914142 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860973:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860978:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860991:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.860995:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919547.860998:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.861004:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.861012:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:2.0:1790919547.861014:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919547.861017:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.861022:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15914149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.861110:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad1591413b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e38 expref: 48 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.861125:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e38 expref: 47 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919547.861132:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:2.0:1790919547.861135:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919547.861137:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204ae00, rc 0) 00000100:00100000:2.0:1790919547.861167:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+47:12399:x1877914958245504:12345-192.168.203.11@tcp:101:stat.0 Request processed in 25409us (25834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919547.861183:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:0.0:1790919547.948936:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919547.949024:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958246144 00000100:00100000:3.0:1790919547.949035:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958246144 00000100:00100000:3.0:1790919547.949118:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:3.0:1790919547.949128:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+47:12405:x1877914958246144:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:3.0:1790919547.949187:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919547.949213:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914150 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e38 expref: 47 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.949251:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919547.949256:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919547.949474:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.949488:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.949497:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919547.949543:0:6445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1790919547.949565:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005e7011a4 reply state 0000000092b169f4 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.949576:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919547.949582:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919547.949584:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919547.949586:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919547.949675:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+49:12405:x1877914958246144:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 549us (748us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1790919547.949683:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000020:00080000:3.0:1790919547.949687:0:6445:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790919548.123614:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919548.123723:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958246272 00000100:00100000:0.0:1790919548.123733:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958246272 00000100:00100000:0.0:1790919548.123806:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:0.0:1790919548.123818:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+49:12419:x1877914958246272:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:0.0:1790919548.123842:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919548.123862:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad1591415e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e3f expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.123924:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.123952:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.123965:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.123977:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.123984:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.123990:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124125:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124135:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124142:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919548.124173:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790919548.124178:0:13325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919548.124198:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124209:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124229:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124235:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124242:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124248:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919548.124252:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124260:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124272:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919548.124275:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919548.124280:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124287:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914165 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124298:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124304:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124310:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124322:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919548.124325:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124331:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124350:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:0.0:1790919548.124352:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919548.124355:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124362:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591416c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124389:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad1591415e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 51 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124403:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 50 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.124411:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:0.0:1790919548.124413:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919548.124415:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015600, rc 0) 00000100:00100000:0.0:1790919548.124473:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+50:12419:x1877914958246272:12345-192.168.203.11@tcp:101:stat.0 Request processed in 658us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919548.124480:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00080000:3.0:1790919548.124916:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919548.192680:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.192940:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958246528 00000100:00100000:3.0:1790919548.192952:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958246528 00000100:00100000:3.0:1790919548.193078:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:3.0:1790919548.193103:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+50:12429:x1877914958246528:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919548.193125:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919548.193147:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591417a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e46 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919548.193267:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790919548.193522:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591417a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e46 expref: 52 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.193536:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919548.193539:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919548.193545:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591417a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e46 expref: 52 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.193570:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d400, rc 0) 00000100:00100000:3.0:1790919548.193636:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:12429:x1877914958246528:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 534us (965us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1790919548.193644:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:2.0:1790919548.198179:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919548.198306:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958246784 00000100:00100000:1.0:1790919548.198315:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958246784 00000100:00100000:1.0:1790919548.198379:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790919548.198396:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390323050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:12429:x1877914958246784:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919548.198639:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390323050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+52:12429:x1877914958246784:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 245us (469us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1790919548.198647:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:0.0:1790919548.266449:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.266617:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958247040 00000100:00100000:3.0:1790919548.266628:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958247040 00000100:00100000:3.0:1790919548.266714:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:3.0:1790919548.266732:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+52:12435:x1877914958247040:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919548.266859:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919548.266879:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914188 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e4d expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.267196:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.267219:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 53 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.267228:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.267261:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 53 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.267275:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 53 pid: 13325 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919548.267288:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978226176:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919548.267423:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919548.271166:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919548.271316:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958247168 00000100:00100000:1.0:1790919548.271326:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958247168 00010000:00010000:1.0:1790919548.271399:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 54 pid: 13325 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919548.271439:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:1.0:1790919548.271448:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:2413:x1877914958247168:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919548.271463:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919548.271469:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 54 pid: 13325 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.271481:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 54 pid: 13325 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.271502:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.271507:0:7709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.271516:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.271524:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.271549:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919548.271620:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:2413:x1877914958247168:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 172us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919548.271628:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00010000:00010000:3.0:1790919548.272621:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914173 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e3f expref: 53 pid: 13325 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919548.272642:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978226176:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919548.272665:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.272675:0:6445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.272681:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919548.272701:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1790919548.273296:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914188 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 54 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.273315:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 53 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.273324:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919548.273327:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790919548.273330:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:3.0:1790919548.273401:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+53:12435:x1877914958247040:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6678us (6961us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1790919548.273409:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:2.0:1790919548.287151:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919548.287309:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958247424 00000100:00100000:0.0:1790919548.287320:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958247424 00000100:00100000:0.0:1790919548.287398:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:0.0:1790919548.287408:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+53:12435:x1877914958247424:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:0.0:1790919548.287679:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.287697:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919548.287707:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919548.288147:0:13325:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1790919548.288290:0:13325:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006dc71afe reply state 00000000bd23a512 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.288316:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.288324:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.288327:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919548.288332:0:13325:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919548.288443:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12435:x1877914958247424:12345-192.168.203.11@tcp:36:bash.0 Request processed in 1036us (1301us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1790919548.288452:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000020:00080000:1.0:1790919548.288458:0:13325:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790919548.297151:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.297246:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958247552 00000100:00100000:3.0:1790919548.297256:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958247552 00000100:00100000:3.0:1790919548.297312:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:3.0:1790919548.297322:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12435:x1877914958247552:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919548.297355:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919548.297375:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e54 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.297456:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.297470:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 57 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.297478:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.297528:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 57 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.297541:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 57 pid: 6445 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919548.297554:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978226304:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919548.297642:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919548.300746:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919548.300832:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958247680 00000100:00100000:2.0:1790919548.300841:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958247680 00010000:00010000:2.0:1790919548.300880:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 58 pid: 6445 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919548.300922:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:2.0:1790919548.300932:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:2414:x1877914958247680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919548.300945:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919548.300951:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 58 pid: 6445 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.300968:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 58 pid: 6445 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.300989:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:2.0:1790919548.300993:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.301003:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.301009:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.301039:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919548.301121:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:2414:x1877914958247680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 188us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919548.301129:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00010000:00010000:3.0:1790919548.301156:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad1591418f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e4d expref: 57 pid: 6445 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919548.301176:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978226304:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919548.301199:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.301208:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.301214:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919548.301257:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790919548.301261:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919548.301279:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.301309:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e54 expref: 57 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.301336:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e54 expref: 56 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.301359:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919548.301362:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919548.301364:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d800, rc 0) 00000100:00100000:3.0:1790919548.301406:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12435:x1877914958247552:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4086us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919548.301414:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:1.0:1790919548.308132:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919548.308218:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958247936 00000100:00100000:0.0:1790919548.308227:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958247936 00000100:00100000:0.0:1790919548.308280:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1790919548.308290:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12435:x1877914958247936:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1790919548.308539:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+57:12435:x1877914958247936:12345-192.168.203.11@tcp:35:bash.0 Request processed in 249us (415us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1790919548.308546:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00010000:00010000:3.0:1790919548.316655:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790919548.353570:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000004:00080000:2.0:1790919548.353618:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790919548.353648:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f285f86e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1790919548.353653:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f39884b300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f285f86cc0 00000020:00080000:2.0:1790919548.353656:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f39884bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f3c2158800 00000020:00080000:2.0:1790919548.353718:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1790919548.353902:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1790919548.353954:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.353966:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.353974:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.353980:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.353985:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.353992:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354022:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95f392142c00) 00010000:00010000:1.0:1790919548.354026:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.354030:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354038:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad15913ff9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354078:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354086:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354092:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354096:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.354099:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354104:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354111:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919548.354113:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.354117:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354123:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914000 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354146:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354153:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354159:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354164:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.354167:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354173:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354180:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:1.0:1790919548.354183:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.354186:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354192:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad1591403f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354206:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354212:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354218:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354229:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.354233:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354239:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354247:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.354249:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.354252:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354258:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914134 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354269:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354274:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354280:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354285:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.354288:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354294:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354310:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.354312:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.354316:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354321:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914157 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354330:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354336:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354351:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354356:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.354359:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354365:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354371:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.354374:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.354376:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.354382:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad1591419d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919548.354783:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978226432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790919548.354846:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919548.354929:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978226432 00000100:00100000:2.0:1790919548.354937:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978226432 00000100:00100000:2.0:1790919548.354994:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790919548.355002:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978226432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790919548.355025:0:8083:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1790919548.355071:0:8083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abf437b, atime: 0x6abf437b, ctime: 0x6abf437b, blocks: 0x1 00010000:00010000:2.0:1790919548.355078:0:8083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.355092:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1790919548.355096:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919548.355103:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.355117:0:8083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.355134:0:8083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.355141:0:8083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.355157:0:8083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1790919548.355667:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919548.356043:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3461:x1877914978226432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1039us (1194us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790919548.356066:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1790919548.356092:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919548.356098:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.356106:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ae00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919548.356111:0:7708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.356120:0:7708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.356134:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.356141:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403b71d9/0x951c50ad159141b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.356167:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919548.356169:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919548.356170:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790919548.356263:0:3461:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f2839ae680/2, rc 0, transno 4294967308 00000100:00100000:1.0:1790919548.356269:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978226432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790919548.393194:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.393272:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958248192 00000100:00100000:3.0:1790919548.393281:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958248192 00000100:00100000:3.0:1790919548.393347:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:3.0:1790919548.393356:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+16:12445:x1877914958248192:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919548.393381:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919548.393399:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e5b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919548.393492:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790919548.393734:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e5b expref: 18 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.393758:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919548.393761:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919548.393766:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e5b expref: 18 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.393792:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d400, rc 0) 00000100:00100000:3.0:1790919548.393853:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:12445:x1877914958248192:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 497us (668us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1790919548.393861:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:2.0:1790919548.398236:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919548.398396:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958248320 00000100:00100000:1.0:1790919548.398406:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958248320 00000100:00100000:1.0:1790919548.398469:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:1.0:1790919548.398478:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:12445:x1877914958248320:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1790919548.398562:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398579:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398590:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398605:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398612:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398618:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398916:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398937:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.398945:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919548.398986:0:10757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399008:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399015:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399022:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399028:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.399032:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399041:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399090:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919548.399093:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.399098:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399105:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad159141c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399123:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399129:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399135:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399140:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.399143:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399148:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399157:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f392142400) 00010000:00010000:1.0:1790919548.399159:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.399162:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399168:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad159141ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399184:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399191:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399197:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399208:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919548.399211:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399217:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399225:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.399227:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919548.399230:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.399236:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad159141d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919548.399309:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:12445:x1877914958248320:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 830us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919548.399317:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:1.0:1790919548.403940:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.404275:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958248576 00000100:00100000:3.0:1790919548.404287:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958248576 00000100:00100000:3.0:1790919548.404380:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:3.0:1790919548.404390:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+17:12445:x1877914958248576:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790919548.404646:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12445:x1877914958248576:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 257us (714us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790919548.404654:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1790919548.445645:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919548.446946:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958248832 00000100:00100000:2.0:1790919548.446960:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958248832 00000100:00100000:2.0:1790919548.447088:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:2.0:1790919548.447099:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12448:x1877914958248832:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919548.447128:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919548.447150:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159141dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e62 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447227:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447242:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447253:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447279:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447287:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447293:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447638:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159141f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447648:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159141f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447656:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159141f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919548.447675:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790919548.447761:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447768:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447774:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447780:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919548.447784:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447793:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447804:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919548.447806:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919548.447811:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447826:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159141e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447839:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447845:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447851:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447856:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ae00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919548.447859:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447880:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447889:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314af00) 00010000:00010000:2.0:1790919548.447891:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919548.447894:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447900:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159141ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447943:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159141dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e62 expref: 21 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447957:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159141f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e62 expref: 20 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.447971:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:2.0:1790919548.447973:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919548.447976:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919548.448050:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12448:x1877914958248832:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 952us (2415us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790919548.448111:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:0.0:1790919548.458356:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919548.458468:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919548.459009:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958249088 00000100:00100000:2.0:1790919548.459020:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958249088 00000100:00100000:2.0:1790919548.459124:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790919548.459134:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:2413:x1877914958249088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919548.459150:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919548.459175:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159141f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e62 expref: 20 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.459192:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:2.0:1790919548.459197:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919548.459261:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:2413:x1877914958249088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 128us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919548.459278:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790919548.460379:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958248960 00000100:00100000:3.0:1790919548.460390:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958248960 00000100:00100000:3.0:1790919548.460451:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:3.0:1790919548.460863:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:12448:x1877914958248960:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1790919548.460929:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.460946:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.460957:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.460984:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.461018:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.461025:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.461031:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919548.461036:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.461045:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.461090:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:3.0:1790919548.461094:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919548.461098:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.461104:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159141ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919548.461175:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:12448:x1877914958248960:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 716us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919548.461183:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:0.0:1790919548.463304:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919548.463436:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958249344 00000100:00100000:1.0:1790919548.463445:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958249344 00000100:00100000:1.0:1790919548.463502:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1790919548.463512:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:12448:x1877914958249344:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919548.463810:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12448:x1877914958249344:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 298us (512us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790919548.463818:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1790919548.629158:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919548.629363:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958249600 00000100:00100000:2.0:1790919548.629438:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958249600 00000100:00100000:2.0:1790919548.629534:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:2.0:1790919548.629545:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12466:x1877914958249600:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1790919548.629570:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919548.629591:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914206 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e69 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.629707:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591420d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.629722:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591420d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.629744:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591420d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919548.629755:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790919548.629878:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914206 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e69 expref: 23 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.629897:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591420d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e69 expref: 22 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.629906:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:2.0:1790919548.629910:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790919548.629913:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696000, rc 0) 00000100:00100000:2.0:1790919548.629977:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b59a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12466:x1877914958249600:12345-192.168.203.11@tcp:101:cat.0 Request processed in 434us (829us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790919548.629984:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:0.0:1790919548.653177:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.653265:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958249728 00000100:00100000:3.0:1790919548.653274:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958249728 00000100:00100000:3.0:1790919548.653333:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:3.0:1790919548.653355:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12467:x1877914958249728:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919548.653389:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919548.653423:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591421b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e70 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.653503:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.653517:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.653527:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919548.653559:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790919548.653563:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919548.653585:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.653610:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591421b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e70 expref: 24 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.653634:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e70 expref: 23 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.653642:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919548.653645:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919548.653648:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:3.0:1790919548.653710:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12467:x1877914958249728:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 357us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919548.653717:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:0.0:1790919548.661174:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919548.661286:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958250112 00000100:00100000:1.0:1790919548.661307:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958250112 00000100:00100000:1.0:1790919548.661409:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1790919548.661420:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12467:x1877914958250112:12345-192.168.203.11@tcp:35:lfs.0 00000001:00080000:1.0:1790919548.662110:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967458 00000100:00100000:1.0:1790919548.662217:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12467:x1877914958250112:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 798us (1051us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1790919548.662226:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000020:00080000:1.0:1790919548.662231:0:6448:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919548.664937:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919548.665028:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958250240 00000100:00100000:1.0:1790919548.665037:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958250240 00000100:00100000:1.0:1790919548.665134:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1790919548.665144:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12467:x1877914958250240:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:1.0:1790919548.665161:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790919548.665186:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159141ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e54 expref: 25 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.665209:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591420d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e69 expref: 24 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.665225:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159140b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e15 expref: 23 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919548.665235:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f382b81900) 00010000:00010000:1.0:1790919548.665246:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919548.665295:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12467:x1877914958250240:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 152us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919548.665303:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1790919548.668926:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919548.669010:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958250368 00000100:00100000:3.0:1790919548.669034:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958250368 00000100:00100000:3.0:1790919548.669120:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:3.0:1790919548.669132:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12467:x1877914958250368:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:3.0:1790919548.669233:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.669250:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919548.669261:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919548.669839:0:6445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790919548.669966:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12467:x1877914958250368:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 836us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919548.669975:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:0.0:1790919548.700865:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919548.700961:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958250496 00000100:00100000:2.0:1790919548.700971:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958250496 00000100:00100000:2.0:1790919548.701038:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1790919548.701049:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:12469:x1877914958250496:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919548.701106:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919548.701141:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914230 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e77 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701211:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701231:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701242:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701258:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701264:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701271:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701602:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701613:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701621:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919548.701662:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790919548.701667:0:13325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919548.701684:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701704:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701713:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701720:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701726:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701732:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919548.701737:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701745:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701757:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919548.701760:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919548.701764:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701770:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad15914237 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701781:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701787:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701799:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701805:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919548.701808:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701814:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701822:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314af00) 00010000:00010000:2.0:1790919548.701825:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919548.701827:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701834:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad1591423e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701869:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 24 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701884:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 23 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919548.701891:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:2.0:1790919548.701893:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919548.701896:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204b200, rc 0) 00000100:00100000:2.0:1790919548.701963:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12469:x1877914958250496:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 915us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919548.701980:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000001:00080000:2.0:1790919548.895023:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1790919548.895042:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1790919548.895113:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1790919549.343611:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919549.380498:0:14181:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790919549.380508:0:14181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919549.380559:0:14181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1790919549.380564:0:14181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790919549.469372:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919549.469381:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919549.469420:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1790919549.469426:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919549.469560:0:13302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978226560:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919549.469655:0:13302:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854000 going to sleep for 11 seconds 00000100:00100000:2.0:1790919549.480410:0:13302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978226560:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790919549.487600:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.487646:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958250624 00000100:00100000:3.0:1790919549.487656:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958250624 00000100:00100000:3.0:1790919549.487709:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:3.0:1790919549.487718:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12482:x1877914958250624:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919549.487750:0:6447:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919549.488306:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12482:x1877914958250624:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 587us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.488315:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:0.0:1790919549.495967:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.496261:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958250752 00000100:00100000:3.0:1790919549.496271:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958250752 00000100:00100000:3.0:1790919549.496322:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:3.0:1790919549.496340:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12482:x1877914958250752:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.496414:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496431:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496442:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496456:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496462:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496468:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496492:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496500:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496506:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919549.496540:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790919549.496544:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919549.496555:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496565:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496577:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496584:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496590:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.496594:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496602:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496612:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919549.496615:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919549.496619:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496625:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591424c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496636:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496642:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496648:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496653:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.496675:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496682:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496690:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff95f3904a5100) 00010000:00010000:3.0:1790919549.496693:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919549.496696:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496702:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914253 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496717:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496722:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496727:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496732:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.496735:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496740:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496747:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919549.496749:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919549.496758:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.496764:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591425a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.496844:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12482:x1877914958250752:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 513us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.496853:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:1.0:1790919549.498823:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.498906:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958251008 00000100:00100000:3.0:1790919549.498914:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958251008 00000100:00100000:3.0:1790919549.498966:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:3.0:1790919549.498974:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12482:x1877914958251008:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.498994:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919549.499012:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15914261 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e7e expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499272:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499287:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499298:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919549.499309:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790919549.499414:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499422:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499439:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499444:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.499448:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499455:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499466:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:3.0:1790919549.499469:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919549.499473:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499479:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499514:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15914261 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e7e expref: 25 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499523:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919549.499525:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919549.499529:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad15914261 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e7e expref: 25 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.499537:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166cc00, rc 0) 00000100:00100000:3.0:1790919549.499594:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12482:x1877914958251008:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 620us (776us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1790919549.499609:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:0.0:1790919549.503280:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.503351:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958251136 00000100:00100000:3.0:1790919549.503361:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958251136 00000100:00100000:3.0:1790919549.503412:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:3.0:1790919549.503421:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12482:x1877914958251136:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919549.503452:0:7785:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919549.503613:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12482:x1877914958251136:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 192us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.503621:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:0.0:1790919549.510721:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.510790:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958251392 00000100:00100000:3.0:1790919549.510801:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958251392 00000100:00100000:3.0:1790919549.510860:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:3.0:1790919549.510870:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12482:x1877914958251392:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.510893:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919549.510896:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790919549.510921:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e70 expref: 24 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.510939:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919549.510944:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919549.510957:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15914276 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e85 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919549.511651:0:6445:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790919549.511954:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad1591427d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.511976:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad1591427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.511989:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad1591427d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.512045:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15914276 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e85 expref: 26 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.512089:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad1591427d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e85 expref: 25 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.512097:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:3.0:1790919549.512100:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919549.512103:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166cc00, rc 0) 00000100:00100000:3.0:1790919549.512166:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12482:x1877914958251392:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1297us (1461us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1790919549.512174:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:0.0:1790919549.515476:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.515918:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958251648 00000100:00100000:3.0:1790919549.515928:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958251648 00000100:00100000:3.0:1790919549.516014:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:3.0:1790919549.516024:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12482:x1877914958251648:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.516096:0:13325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919549.516122:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad1591427d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e85 expref: 25 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516139:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f3904a5100) 00010000:00010000:3.0:1790919549.516169:0:13325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919549.516190:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516202:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516211:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516225:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516231:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516237:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516433:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516441:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516448:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516454:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.516458:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516466:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516481:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919549.516483:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919549.516488:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516494:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad1591428b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516504:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516511:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516517:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516522:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.516525:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516530:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516538:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x90a6a888 (ffff95f3904a5f00) 00010000:00010000:3.0:1790919549.516541:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919549.516543:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.516548:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914292 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x90a6a888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.516633:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12482:x1877914958251648:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 610us (1165us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919549.516641:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:1.0:1790919549.528162:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.529767:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958251776 00000100:00100000:0.0:1790919549.529778:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958251776 00000100:00100000:0.0:1790919549.529834:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:0.0:1790919549.529844:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12482:x1877914958251776:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919549.529864:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919549.529887:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15914299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e8c expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.529922:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.529936:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.529947:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.530036:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad15914299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 26 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.530069:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 25 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.530083:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919549.530086:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790919549.530089:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919549.530147:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12482:x1877914958251776:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 304us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919549.530154:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:0.0:1790919549.534225:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.534307:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958252032 00000100:00100000:3.0:1790919549.534360:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958252032 00000100:00100000:3.0:1790919549.534491:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:3.0:1790919549.534502:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12482:x1877914958252032:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.534581:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.534597:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.534610:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919549.535241:0:6445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1790919549.535253:0:6445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358563199518ns, next at 359563197404ns, rc = 0 00000004:00010000:3.0:1790919549.535327:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001b83519d reply state 000000002d53b14e transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.535352:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.535360:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:3.0:1790919549.535363:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790919549.535367:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919549.535564:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12482:x1877914958252032:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1062us (1345us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790919549.535581:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1790919549.537627:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.538208:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958252160 00000100:00100000:0.0:1790919549.538218:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958252160 00000100:00100000:0.0:1790919549.538442:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1790919549.538453:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12482:x1877914958252160:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919549.538540:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919549.538560:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e93 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.538615:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 28 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.538628:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 28 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.538702:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919549.538905:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919549.538909:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014e00, rc 0) 00000100:00100000:0.0:1790919549.538968:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:12482:x1877914958252160:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 517us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919549.538981:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1790919549.545569:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919549.545695:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958252288 00000100:00100000:2.0:1790919549.545706:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958252288 00000100:00100000:2.0:1790919549.545772:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1790919549.545784:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958252288:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790919549.546286:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958252288:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 503us (725us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790919549.546295:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00080000:2.0:1790919549.546317:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919549.554842:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919549.554877:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958252544 00000100:00100000:2.0:1790919549.554886:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958252544 00000100:00100000:3.0:1790919549.554944:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790919549.555037:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:12482:x1877914958252544:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790919549.555305:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12482:x1877914958252544:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 350us (469us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1790919549.555314:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790919549.559892:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919549.559925:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958252800 00000100:00100000:2.0:1790919549.559934:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958252800 00000100:00100000:2.0:1790919549.559980:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1790919549.559997:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12482:x1877914958252800:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790919549.560113:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12482:x1877914958252800:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 117us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919549.560121:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:0.0:1790919549.570193:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.572647:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958252928 00000100:00100000:3.0:1790919549.572663:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958252928 00000100:00100000:3.0:1790919549.572763:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:3.0:1790919549.572774:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12482:x1877914958252928:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.572794:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919549.572814:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38e9a expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.572879:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159142bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.572893:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159142bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.572904:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159142bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919549.572938:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919549.572955:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159142bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.572997:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e9a expref: 31 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.573013:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159142bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e9a expref: 30 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.573021:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:3.0:1790919549.573023:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790919549.573026:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166da00, rc 0) 00000100:00100000:3.0:1790919549.573105:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:12482:x1877914958252928:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 334us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.573112:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:2.0:1790919549.583036:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.583135:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253056 00000100:00100000:3.0:1790919549.583145:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253056 00000100:00100000:3.0:1790919549.583199:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1790919549.583208:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958253056:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.583225:0:8084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919549.583244:0:8084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ea1 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919549.583270:0:8084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf437e, blocks: 0x1 00010000:00010000:3.0:1790919549.583290:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1790919549.583295:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919549.583304:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 8 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.583351:0:8084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 8 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.583364:0:8084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166cc00, rc 0) 00000100:00100000:3.0:1790919549.583425:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958253056:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 218us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.583432:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1790919549.587184:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.589436:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253312 00000100:00100000:0.0:1790919549.589450:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253312 00000100:00100000:1.0:1790919549.590950:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1790919549.590964:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:12482:x1877914958253312:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790919549.591116:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3be4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:12482:x1877914958253312:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 154us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919549.591124:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:0.0:1790919549.596226:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919549.596299:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253440 00000100:00100000:2.0:1790919549.596309:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253440 00000100:00100000:2.0:1790919549.596375:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1790919549.596386:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:12482:x1877914958253440:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919549.596403:0:8082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919549.596421:0:8082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ea8 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.596453:0:8082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.596462:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919549.596466:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919549.596472:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 9 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.596504:0:8082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.596518:0:8082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919549.596549:0:8082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8082:1877914978226688:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919549.596636:0:8082:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854000 going to sleep for 11 seconds 00000100:00100000:3.0:1790919549.599348:0:8082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8082:1877914978226688:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919549.599380:0:8082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 9 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.599399:0:8082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204aa00, rc 0) 00000100:00100000:3.0:1790919549.599450:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:12482:x1877914958253440:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3065us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.599458:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1790919549.601738:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.602015:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253568 00000100:00100000:1.0:1790919549.602025:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253568 00010000:00010000:1.0:1790919549.602100:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.602134:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1790919549.602145:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958253568:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919549.602160:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919549.602181:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.602195:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.602246:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159142c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea1 expref: 9 pid: 8084 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.602263:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919549.602267:0:12731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919549.602274:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 8 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.602283:0:12731:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 8 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.602320:0:12731:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 8 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.602344:0:12731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:12731:1877914978226816:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790919549.602417:0:12731:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f86240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919549.604736:0:12731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:12731:1877914978226816:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790919549.604759:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919549.604814:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958253568:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2670us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919549.604824:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:2.0:1790919549.612553:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.612679:0:8088:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253696 00000100:00100000:3.0:1790919549.612689:0:8088:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253696 00002000:00100000:3.0:1790919549.612746:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff95f28559a680 x1877914958253696/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:670/0 lens 504/0 e 0 to 0 dl 1790919560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919549.612819:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f28559a680 with x1877914958253696 ext(0->8) 00002000:00010000:3.0:1790919549.612825:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f28559a680 00000100:00100000:3.0:1790919549.612856:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790919549.612866:0:8088:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958253696:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790919549.613503:0:8088:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:2414:x1877914958253696:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 637us (958us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790919549.613511:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00002000:00100000:3.0:1790919549.613518:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff95f28559a680 x1877914958253696/t4294967315(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:670/0 lens 504/448 e 0 to 0 dl 1790919560 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919549.613527:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f28559a680 with x1877914958253696 ext(0->8) 00002000:00010000:3.0:1790919549.613530:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f28559a680 00000100:00100000:2.0:1790919549.623512:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.623612:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253824 00000100:00100000:0.0:1790919549.623622:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253824 00000100:00100000:0.0:1790919549.623666:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:0.0:1790919549.623673:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:12482:x1877914958253824:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790919549.658255:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000020:00080000:3.0:1790919549.658290:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1790919549.658319:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1790919549.658337:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1790919549.658342:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1790919549.658352:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1790919549.658369:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.658381:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.658388:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.658394:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919549.658399:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.658407:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.658422:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:3.0:1790919549.658426:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919549.658443:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.658447:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.658552:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919549.658567:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978226944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790919549.658626:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919549.658732:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978226944 00000100:00100000:2.0:1790919549.658741:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978226944 00000100:00100000:2.0:1790919549.658921:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790919549.658931:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978226944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790919549.659110:0:8084:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790919549.659113:0:8084:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790919550 00002000:00010000:2.0:1790919549.659116:0:8084:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790919549.659118:0:8084:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790919550 -> 1790919550 00002000:00010000:2.0:1790919549.659120:0:8084:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790919549.659165:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978226944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (538us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790919549.659172:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919549.659199:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12482:x1877914958253824:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 35524us (35693us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.659206:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000004:00080000:3.0:1790919549.659245:0:3459:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f2839ad500/2, rc 0, transno 4294967316 00000100:00100000:3.0:1790919549.659251:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978226944:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1790919549.659371:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919549.665921:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.665999:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958253952 00000100:00100000:3.0:1790919549.666009:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958253952 00000100:00100000:3.0:1790919549.666104:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1790919549.666114:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:2413:x1877914958253952:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790919549.708352:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1790919549.708368:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1790919549.708374:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1790919549.708524:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958253952:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 42405us (42616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919549.708537:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790919549.711697:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.712705:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958254208 00000100:00100000:0.0:1790919549.712716:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958254208 00000100:00100000:0.0:1790919549.712780:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1790919549.712791:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12482:x1877914958254208:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919549.712843:0:6445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919549.712868:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159142bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e9a expref: 18 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.712889:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919549.712894:0:6445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919549.712923:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.712949:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.712959:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919549.713252:0:6445:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd9f5138 reply state 000000008d79f0fe transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.713265:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.713271:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919549.713274:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790919549.713277:0:6445:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919549.713386:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:12482:x1877914958254208:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 596us (1697us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1790919549.713393:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:3.0:1790919549.715299:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919549.715471:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958254336 00000100:00100000:2.0:1790919549.715482:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958254336 00000100:00100000:2.0:1790919549.715541:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1790919549.715551:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958254336:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790919549.716407:0:8084:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790919549.716425:0:8084:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790919550 -> 1790919549 00002000:00010000:2.0:1790919549.716428:0:8084:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790919547 00002000:00010000:2.0:1790919549.716431:0:8084:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790919550 -> 1790919549 00002000:00010000:2.0:1790919549.716434:0:8084:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790919549.716634:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958254336:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 1081us (1339us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790919549.716644:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1790919549.724497:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.725580:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958254592 00000100:00100000:3.0:1790919549.725593:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958254592 00000100:00100000:3.0:1790919549.725661:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1790919549.725671:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:12482:x1877914958254592:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790919549.725752:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.725795:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 19 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.725805:0:13325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.725839:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 19 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.725854:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 19 pid: 6447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.725868:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978227072:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919549.725954:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919549.729454:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978227072:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919549.729484:0:13325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919549.730547:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.730898:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958254720 00000100:00100000:3.0:1790919549.730908:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958254720 00010000:00010000:3.0:1790919549.730950:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 20 pid: 6447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.731038:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1790919549.731048:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:2414:x1877914958254720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919549.731206:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919549.731216:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 20 pid: 6447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.731228:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 20 pid: 6447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.731249:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159142a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e8c expref: 20 pid: 6447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.731609:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:2.0:1790919549.731732:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.731853:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.731863:0:13233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.731916:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919549.731980:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:2414:x1877914958254720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 932us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919549.731988:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00010000:00010000:1.0:1790919549.732087:0:13325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732095:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732124:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732191:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732199:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732205:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919549.732209:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732217:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732226:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:1.0:1790919549.732229:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790919549.732233:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.732238:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159142d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.732288:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12482:x1877914958254592:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 6615us (7822us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790919549.732304:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1790919549.734980:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919549.735234:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958254848 00000100:00100000:2.0:1790919549.735245:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958254848 00000100:00100000:2.0:1790919549.735292:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790919549.735302:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958254848:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790919549.735357:0:8082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.735378:0:8082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 8 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.735388:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919549.735392:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790919549.735397:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.735432:0:8082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 8 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.735446:0:8082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 8 pid: 8082 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919549.735461:0:8082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8082:1877914978227200:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919549.735672:0:8082:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386592000 going to sleep for 11 seconds 00000100:00100000:2.0:1790919549.737578:0:8082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8082:1877914978227200:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919549.737606:0:8082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.738612:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.738994:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958254976 00000100:00100000:1.0:1790919549.739002:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958254976 00010000:00010000:1.0:1790919549.739031:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 9 pid: 8082 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.739075:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:1.0:1790919549.739084:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958254976:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919549.739099:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919549.739120:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 9 pid: 8082 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.739206:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 9 pid: 8082 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.739229:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020287886/0x951c50ad159142ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ea8 expref: 9 pid: 8082 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.739252:0:7709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919549.739256:0:7709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919549.739262:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.739272:0:7709:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.739324:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919549.739447:0:8082:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739456:0:8082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739480:0:8082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739487:0:8082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739495:0:8082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739501:0:8082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ae00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919549.739506:0:8082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739515:0:8082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739544:0:8082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.739552:0:8082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403b71d9/0x951c50ad159142df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.739552:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958254976:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 468us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919549.739560:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:2.0:1790919549.739598:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958254848:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 4298us (4626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919549.739610:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1790919549.741484:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.741522:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958255232 00000100:00100000:1.0:1790919549.741531:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958255232 00000100:00100000:1.0:1790919549.741581:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:1.0:1790919549.741590:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12482:x1877914958255232:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790919549.741916:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.741934:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.741945:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.742317:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.742340:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 19 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.742349:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.742491:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 19 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.742525:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 19 pid: 10757 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.742540:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978227328:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919549.742654:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919549.745043:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978227328:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919549.745102:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919549.745973:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.746281:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958255360 00000100:00100000:0.0:1790919549.746376:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958255360 00010000:00010000:0.0:1790919549.746419:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 20 pid: 10757 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919549.746498:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:0.0:1790919549.746510:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:2413:x1877914958255360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919549.746526:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919549.746533:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 20 pid: 10757 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.746566:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 20 pid: 10757 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.746598:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad159142ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e93 expref: 20 pid: 10757 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.746613:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919549.746618:0:6431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.746627:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.746634:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.746665:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919549.746703:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919549.746712:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919549.746726:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:2413:x1877914958255360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 217us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919549.746734:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000001:00080000:2.0:1790919549.746948:0:7785:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1790919549.747111:0:7785:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1790919549.747166:0:7785:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1790919549.747250:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7785:1877914978227456:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790919549.747300:0:7785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919549.747339:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386592600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919549.748194:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978227456 00000100:00100000:2.0:1790919549.748202:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978227456 00000100:00100000:2.0:1790919549.748286:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790919549.748295:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7785:x1877914978227456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790919549.748415:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7785:x1877914978227456:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919549.748424:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790919549.750312:0:7785:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1790919549.750324:0:7785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f2839ad500, transno 4294967316 00000100:00100000:2.0:1790919549.750421:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7785:1877914978227456:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790919549.751518:0:7785:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1790919549.751597:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7785:1877914978227584:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790919549.751677:0:7785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919549.751703:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919549.751803:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978227584 00000100:00100000:3.0:1790919549.751810:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978227584 00000100:00100000:3.0:1790919549.751878:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790919549.751887:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7785:x1877914978227584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790919549.752101:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7785:x1877914978227584:12345-0@lo:1000:mdt00_003.0 Request processed in 215us (423us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790919549.752109:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790919549.752178:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7785:1877914978227584:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790919549.752215:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752226:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752233:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752239:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919549.752243:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752250:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752264:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:1.0:1790919549.752274:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919549.752279:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752285:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad159142ed lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752309:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752315:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752321:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752325:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919549.752335:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752341:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752348:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:1.0:1790919549.752350:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919549.752354:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752359:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914229 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752378:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752400:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 22 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752408:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752433:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 22 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.752447:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 22 pid: 13325 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.752458:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978227712:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919549.752528:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919549.762601:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5a6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978227712:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919549.762633:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919549.763459:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919549.763961:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958255488 00000100:00100000:0.0:1790919549.763970:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958255488 00010000:00010000:0.0:1790919549.764009:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 23 pid: 13325 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919549.764080:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:0.0:1790919549.764091:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:2414:x1877914958255488:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919549.764124:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919549.764132:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 23 pid: 13325 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.764145:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 23 pid: 13325 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.764167:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38e77 expref: 23 pid: 13325 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.764194:0:6432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:0.0:1790919549.764199:0:6432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.764209:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.764217:0:6432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.764247:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919549.764294:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764302:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919549.764310:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:2414:x1877914958255488:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 221us (854us total) trans 0 rc 0/0 00010000:00010000:1.0:1790919549.764314:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919549.764318:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00010000:00010000:1.0:1790919549.764322:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764344:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764351:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919549.764356:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764363:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764372:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:1.0:1790919549.764375:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919549.764378:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764385:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d000/0x951c50ad159142f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764397:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764403:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764409:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764415:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919549.764417:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764434:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764443:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5d00) 00010000:00010000:1.0:1790919549.764446:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790919549.764449:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919549.764454:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159142e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919549.764657:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:12482:x1877914958255232:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 23067us (23180us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790919549.764667:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000020:00080000:1.0:1790919549.764672:0:7785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790919549.764844:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919549.764849:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919549.765360:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1790919549.765369:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919549.769211:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.769304:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958255744 00000100:00100000:3.0:1790919549.769314:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958255744 00000100:00100000:3.0:1790919549.769395:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:3.0:1790919549.769405:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390321450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:12482:x1877914958255744:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790919549.770529:0:6449:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790919549.770641:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1790919549.770690:0:6449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.770708:0:6449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.770720:0:6449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.770871:0:6449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.770879:0:6449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.770885:0:6449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919549.770912:0:6449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919549.770962:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919549.770970:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.770979:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919549.770991:0:6434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.771001:0:6434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.771015:0:6434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919549.771018:0:6434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1790919549.771024:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390321450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12482:x1877914958255744:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1617us (1820us total) trans 4294967471 rc 0/0 00010000:00010000:0.0:1790919549.771025:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.771033:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159142fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919549.771067:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919549.771069:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919549.771071:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919549.771260:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000020:00080000:3.0:1790919549.771265:0:6449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790919549.852767:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919549.852790:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978227840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919549.852859:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919549.852958:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978227840 00000100:00100000:0.0:1790919549.852966:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978227840 00000100:00100000:0.0:1790919549.853021:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790919549.853031:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978227840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919549.853090:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919549.853140:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978227840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919549.853147:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790919549.853234:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978227840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919549.853396:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919549.853406:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978227968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919549.853433:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919549.853565:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978227968 00000100:00100000:2.0:1790919549.853569:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978227968 00000100:00100000:2.0:1790919549.853601:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790919549.853608:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978227968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919549.853629:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919549.853671:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978227968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919549.853677:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790919549.853770:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978227968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919549.898154:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919549.898496:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.898583:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958256000 00000100:00100000:1.0:1790919549.898594:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958256000 00000100:00100000:1.0:1790919549.898676:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:1.0:1790919549.898688:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958256000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:2.0:1790919549.898747:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919549.898797:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958256000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919549.898805:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:1.0:1790919549.900181:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.900249:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.900268:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919549.900290:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958256384 00000100:00100000:1.0:1790919549.900298:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958256384 00000100:00100000:3.0:1790919549.900338:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958256128 00000100:00100000:3.0:1790919549.900342:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958256128 00000100:00100000:1.0:1790919549.901976:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958256256 00000100:00100000:1.0:1790919549.901988:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958256256 00000100:00100000:3.0:1790919549.902067:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:3.0:1790919549.902078:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958256128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919549.902155:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958256128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.902162:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:3.0:1790919549.902192:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00100000:3.0:1790919549.902200:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958256384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919549.902223:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958256384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919549.902229:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00080000:2.0:1790919549.902515:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919549.902521:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919549.902523:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919549.902997:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958255872 00000100:00100000:0.0:1790919549.903006:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958255872 00000100:00100000:0.0:1790919549.903069:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 379 00000100:00100000:0.0:1790919549.903078:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958255872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919549.903119:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958255872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (4988us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919549.903365:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 379 00000100:00100000:1.0:1790919549.905310:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:1.0:1790919549.905322:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958256256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919549.905411:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958256256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (5141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919549.905419:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 281 00010000:00010000:2.0:1790919550.364227:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919550.364447:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978228224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919550.364533:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919550.364605:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978228224 00000100:00100000:0.0:1790919550.364613:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978228224 00000100:00100000:0.0:1790919550.364681:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790919550.364694:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978228224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919550.364718:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1790919550.364855:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978228224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919550.364865:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790919550.364929:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978228224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919550.367813:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919550.367841:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978228096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919550.367916:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919550.368042:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978228096 00000100:00100000:0.0:1790919550.368080:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978228096 00000100:00080000:2.0:1790919550.368082:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919550.368153:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790919550.368162:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978228096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919550.368186:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1790919550.368233:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978228096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919550.368240:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790919550.368549:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978228096:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790919550.692441:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790919550.816491:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919550.816501:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919550.816933:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790919550.816942:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790919551.047515:0:14235:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919551.047528:0:14235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919551.047573:0:14235:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790919551.047580:0:14235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919551.173545:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.173725:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958256640 00000100:00100000:1.0:1790919551.173735:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958256640 00000100:00100000:1.0:1790919551.173805:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:1.0:1790919551.173815:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+23:12500:x1877914958256640:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919551.173839:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919551.173857:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38eaf expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.173947:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914309 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.173960:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914309 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.173980:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914309 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919551.173991:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790919551.174127:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eaf expref: 26 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.174146:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914309 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eaf expref: 25 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.174155:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919551.174158:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919551.174162:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1de00, rc 0) 00000100:00100000:1.0:1790919551.174218:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12500:x1877914958256640:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 403us (681us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790919551.174226:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00080000:2.0:1790919551.174404:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919551.177789:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.177863:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958256768 00000100:00100000:3.0:1790919551.177878:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958256768 00000100:00100000:3.0:1790919551.177963:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:3.0:1790919551.177973:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12500:x1877914958256768:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1790919551.178048:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178093:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178104:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178121:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178128:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178135:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178360:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178369:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178377:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919551.178415:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178438:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178458:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178466:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178472:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.178477:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178485:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178497:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919551.178500:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.178504:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178511:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178533:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178540:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178546:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178557:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.178561:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178567:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178575:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f3904a5b00) 00010000:00010000:3.0:1790919551.178577:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.178580:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178586:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad1591431e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178602:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178608:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178613:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178618:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.178621:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178626:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178643:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919551.178646:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.178649:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.178654:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15914325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919551.178750:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12500:x1877914958256768:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 778us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919551.178758:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:1.0:1790919551.234453:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919551.234540:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958257024 00000100:00100000:2.0:1790919551.234550:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958257024 00000100:00100000:2.0:1790919551.234604:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:2.0:1790919551.234614:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12503:x1877914958257024:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919551.234634:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919551.234654:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591432c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38eb6 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.234719:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.234734:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.234745:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.234758:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.234765:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.234771:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235184:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235201:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235208:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919551.235218:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790919551.235311:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235329:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235336:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235341:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919551.235346:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235353:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235364:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919551.235368:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919551.235372:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235378:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad15914333 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235390:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235402:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235408:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235413:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204ae00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919551.235416:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235422:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235431:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:2.0:1790919551.235433:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919551.235436:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235442:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad1591433a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235484:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad1591432c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 28 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235498:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 27 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.235505:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:2.0:1790919551.235507:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919551.236050:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919551.236254:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12503:x1877914958257024:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1639us (1811us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1790919551.236263:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:1.0:1790919551.251374:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.251484:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958257152 00000100:00100000:0.0:1790919551.251495:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958257152 00000100:00100000:0.0:1790919551.251557:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:0.0:1790919551.251567:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12503:x1877914958257152:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790919551.251628:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251645:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251656:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251679:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251686:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251693:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251699:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919551.251703:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251710:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251720:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:0.0:1790919551.251723:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919551.251739:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.251746:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591434f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.251819:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12503:x1877914958257152:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 247us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.251827:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:0.0:1790919551.259698:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.262490:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958257408 00000100:00100000:1.0:1790919551.262512:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958257408 00000100:00100000:1.0:1790919551.262614:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1790919551.262627:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12503:x1877914958257408:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919551.263139:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:12503:x1877914958257408:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 511us (3452us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1790919551.263149:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1790919551.303027:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.304132:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958257664 00000100:00100000:0.0:1790919551.304250:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958257664 00000100:00100000:0.0:1790919551.304350:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:0.0:1790919551.304363:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:12026:x1877914958257664:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919551.304398:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919551.304427:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914356 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ebd expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.304574:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.304594:0:13325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 29 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.304605:0:13325:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.304652:0:13325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 29 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.304690:0:13325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 29 pid: 10757 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.304707:0:13325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c09180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978228352:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919551.304823:0:13325:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece300 going to sleep for 11 seconds 00000100:00100000:0.0:1790919551.311934:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.312103:0:13325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c09180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13325:1877914978228352:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919551.312144:0:13325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919551.312666:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958257792 00000100:00100000:2.0:1790919551.312678:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958257792 00010000:00010000:2.0:1790919551.312731:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 30 pid: 10757 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919551.312779:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:2.0:1790919551.312789:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:2414:x1877914958257792:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919551.312808:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919551.312816:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 30 pid: 10757 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.312830:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 30 pid: 10757 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.312865:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914341 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eb6 expref: 30 pid: 10757 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.312886:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:2.0:1790919551.312891:0:6430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.312903:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.312912:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.313095:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919551.313173:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:2414:x1877914958257792:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 385us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.313182:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00010000:00010000:0.0:1790919551.320979:0:13325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.321002:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919551.321037:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790919551.321462:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914356 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 30 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.321487:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 29 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.321497:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:0.0:1790919551.321501:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919551.321504:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00000100:00100000:0.0:1790919551.321656:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12026:x1877914958257664:12345-192.168.203.11@tcp:101:bash.0 Request processed in 17294us (18646us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1790919551.321672:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:0.0:1790919551.329620:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.329751:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258048 00000100:00100000:3.0:1790919551.329764:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258048 00000100:00100000:3.0:1790919551.329833:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:3.0:1790919551.329844:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12026:x1877914958258048:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1790919551.330252:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.330275:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.330289:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919551.330361:0:7785:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1790919551.330387:0:7785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007e3170fc reply state 0000000051d2eb11 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.330402:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.330419:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:3.0:1790919551.330423:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919551.330427:0:7785:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790919551.330485:0:7785:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1790919551.330635:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+33:12026:x1877914958258048:12345-192.168.203.11@tcp:36:bash.0 Request processed in 790us (1027us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1790919551.330645:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000020:00080000:3.0:1790919551.330651:0:7785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790919551.344270:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.344830:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258176 00000100:00100000:3.0:1790919551.344844:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258176 00000100:00100000:3.0:1790919551.344923:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:3.0:1790919551.344935:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+33:12026:x1877914958258176:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919551.345956:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919551.346843:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15914372 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ec4 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.346941:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15914372 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ec4 expref: 34 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.346959:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15914372 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ec4 expref: 34 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.346992:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:3.0:1790919551.346995:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919551.347000:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d200, rc 0) 00000100:00100000:3.0:1790919551.347111:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:12026:x1877914958258176:12345-192.168.203.11@tcp:101:bash.0 Request processed in 2177us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919551.347143:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:1.0:1790919551.350233:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.350350:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258304 00000100:00100000:0.0:1790919551.350362:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258304 00000100:00100000:0.0:1790919551.350503:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790919551.350517:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:12026:x1877914958258304:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919551.350540:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919551.350568:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ecb expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919551.350602:0:8248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abf437d, atime: 0x6abf437b, ctime: 0x6abf437d, blocks: 0xb 00010000:00010000:0.0:1790919551.350629:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1790919551.350635:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919551.350644:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 8 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.350664:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 8 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.350678:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014e00, rc 0) 00000100:00100000:0.0:1790919551.350763:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:12026:x1877914958258304:12345-192.168.203.11@tcp:101:bash.0 Request processed in 249us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.350771:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00080000:2.0:1790919551.353659:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919551.356457:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.356577:0:8089:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258432 00000100:00100000:1.0:1790919551.356590:0:8089:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258432 00002000:00010000:1.0:1790919551.356649:0:8089:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1790919551.356657:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f284c09c00 with x1877914958258432 ext(0->18446744073709551615) 00002000:00010000:1.0:1790919551.356673:0:8089:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f284c09c00. 00000100:00100000:1.0:1790919551.356765:0:8089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790919551.356778:0:8089:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958258432:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:1.0:1790919551.357329:0:8089:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790919551.357334:0:8089:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790919549 -> 1790919552 00002000:00010000:1.0:1790919551.357340:0:8089:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1790919547 -> 1790919547 00002000:00010000:1.0:1790919551.357343:0:8089:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790919549 -> 1790919552 00002000:00010000:1.0:1790919551.357346:0:8089:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790919551.357434:0:8089:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2413:x1877914958258432:12345-192.168.203.11@tcp:10:bash.0 Request processed in 657us (990us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1790919551.357444:0:8089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00002000:00010000:1.0:1790919551.357449:0:8089:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1790919551.357451:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f284c09c00 with x1877914958258432 ext(0->18446744073709551615) 00002000:00010000:1.0:1790919551.357457:0:8089:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f284c09c00. 00010000:00010000:0.0:1790919551.388707:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919551.459744:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.459888:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258560 00000100:00100000:3.0:1790919551.459904:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258560 00000100:00100000:3.0:1790919551.459986:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:3.0:1790919551.459997:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:12517:x1877914958258560:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1790919551.460145:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460168:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460181:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460200:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460208:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460214:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460676:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460689:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.460698:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919551.461012:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461026:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461034:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461042:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461048:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.461204:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461214:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461229:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919551.461232:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.461238:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461245:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914380 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461261:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461267:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461282:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461287:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.461290:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461296:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461304:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919551.461307:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.461310:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461328:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15914387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461346:0:6447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461352:0:6447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461788:0:6447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461794:0:6447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.461797:0:6447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461815:0:6447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461825:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:3.0:1790919551.461827:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.461831:0:6447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.461837:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591438e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919551.466432:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:12517:x1877914958258560:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 6419us (6695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.466451:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:2.0:1790919551.507394:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.507606:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258816 00000100:00100000:3.0:1790919551.507620:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258816 00000100:00100000:3.0:1790919551.507735:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:3.0:1790919551.507748:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+34:12520:x1877914958258816:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919551.507778:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919551.507805:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914395 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ed2 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.507909:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.507927:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.507940:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.507957:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.507989:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.507997:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.508837:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159143aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.508852:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159143aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.508861:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159143aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919551.508873:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790919551.508996:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509006:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509014:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509020:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.509025:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509034:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509082:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919551.509085:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.509090:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509097:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591439c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509113:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509120:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509204:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509212:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.509215:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509222:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509231:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919551.509234:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.509237:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509244:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad159143a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509312:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad15914395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ed2 expref: 37 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509338:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159143aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ed2 expref: 36 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.509346:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:3.0:1790919551.509348:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790919551.509350:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c200, rc 0) 00000100:00100000:3.0:1790919551.509574:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:12520:x1877914958258816:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1827us (2192us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790919551.509584:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:0.0:1790919551.513274:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.513433:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958258944 00000100:00100000:1.0:1790919551.513467:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958258944 00000100:00100000:1.0:1790919551.513538:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1790919551.513549:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:12520:x1877914958258944:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1790919551.513643:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.513660:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 36 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.513671:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.513785:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 36 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.513802:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 36 pid: 13325 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919551.513820:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978228480:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919551.513982:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285f86d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919551.517605:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.517645:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978228480:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919551.517690:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958259200 00000100:00100000:3.0:1790919551.517700:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958259200 00010000:00010000:0.0:1790919551.517799:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919551.517876:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1790919551.517886:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:6383:x1877914958259200:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790919551.518273:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:6383:x1877914958259200:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 387us (680us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790919551.518281:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1790919551.520416:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.520590:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958259328 00000100:00100000:1.0:1790919551.520600:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958259328 00010000:00010000:1.0:1790919551.520645:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 38 pid: 13325 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919551.520692:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1790919551.520703:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+38:2413:x1877914958259328:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919551.520869:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919551.520878:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 38 pid: 13325 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.520894:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 38 pid: 13325 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.520921:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591435d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ebd expref: 38 pid: 13325 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.520939:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:1.0:1790919551.520946:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.520957:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.520967:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.520997:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919551.521030:0:6445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521039:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919551.521096:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:2413:x1877914958259328:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 394us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919551.521104:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00010000:00010000:0.0:1790919551.521105:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521112:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521119:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521136:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919551.521142:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521150:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521160:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:0.0:1790919551.521163:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919551.521167:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.521182:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad159143b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.521229:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:12520:x1877914958258944:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 7682us (7972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.521245:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:0.0:1790919551.523585:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919551.523662:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958259584 00000100:00100000:2.0:1790919551.523674:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958259584 00000100:00100000:2.0:1790919551.523885:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1790919551.523898:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+36:12520:x1877914958259584:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919551.524257:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:12520:x1877914958259584:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 361us (684us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790919551.524268:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1790919551.629027:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.629415:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958259840 00000100:00100000:0.0:1790919551.629430:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958259840 00000100:00100000:0.0:1790919551.629521:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:0.0:1790919551.629533:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+37:12531:x1877914958259840:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1790919551.629570:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919551.629599:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159143bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ed9 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.629699:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.629730:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.629746:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.629765:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.629773:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.629781:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630458:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159143d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630481:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159143d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630490:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159143d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919551.630502:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1790919551.630625:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630634:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630641:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630648:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919551.630653:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630662:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630676:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919551.630680:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919551.630685:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630692:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159143c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630705:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630717:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630724:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630729:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919551.630732:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630738:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630745:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f382b81a00) 00010000:00010000:0.0:1790919551.630747:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919551.630750:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630755:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159143cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630817:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159143bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ed9 expref: 40 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630832:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159143d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ed9 expref: 39 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.630839:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:0.0:1790919551.630842:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919551.630854:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014c00, rc 0) 00000100:00100000:0.0:1790919551.631036:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:12531:x1877914958259840:12345-192.168.203.11@tcp:101:cat.0 Request processed in 1426us (1944us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790919551.631047:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:1.0:1790919551.638684:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.639105:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958260096 00000100:00100000:3.0:1790919551.639119:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958260096 00000100:00100000:3.0:1790919551.639189:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1790919551.639200:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:12531:x1877914958260096:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1790919551.639568:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+40:12531:x1877914958260096:12345-192.168.203.11@tcp:35:cat.0 Request processed in 368us (898us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1790919551.639597:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1790919551.666647:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919551.666837:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958260352 00000100:00100000:2.0:1790919551.666851:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958260352 00000100:00100000:2.0:1790919551.666918:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:2.0:1790919551.666929:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+40:12532:x1877914958260352:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1790919551.667005:0:10757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790919551.667039:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159143d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ed9 expref: 40 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667141:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159143aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ed2 expref: 39 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667158:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad15914372 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ec4 expref: 38 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667170:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:2.0:1790919551.667176:0:10757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919551.667207:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667225:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667237:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667254:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667261:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667267:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667578:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667587:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.667600:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919551.668332:0:10757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1790919551.668346:0:10757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360696293231ns, next at 361696290204ns, rc = 0 00010000:00010000:2.0:1790919551.668423:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668436:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668445:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668453:0:10757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668461:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668468:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668499:0:10757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919551.668527:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668534:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668540:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668554:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919551.668559:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668567:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668579:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:2.0:1790919551.668583:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790919551.668587:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668594:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159143f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668616:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668621:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668627:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668632:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919551.668636:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668641:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668658:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919551.668661:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919551.668664:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668670:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159143e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919551.668684:0:10757:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000470c3b7a reply state 000000009b74fd67 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668697:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.668704:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:2.0:1790919551.668706:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919551.668709:0:10757:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919551.668810:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:12532:x1877914958260352:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1878us (2172us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790919551.668825:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00010000:00010000:1.0:1790919551.669171:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919551.669180:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.669200:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204aa00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919551.669204:0:6434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.669211:0:6434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.669220:0:6434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:1.0:1790919551.669222:0:6434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790919551.669225:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.669230:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159143f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.669244:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919551.669245:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919551.669246:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919551.735506:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.735605:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958260608 00000100:00100000:3.0:1790919551.735619:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958260608 00000100:00100000:3.0:1790919551.735694:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:3.0:1790919551.735706:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+39:12538:x1877914958260608:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919551.735751:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919551.735779:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159143fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ee0 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.736089:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.736111:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.736123:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.736135:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.736142:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.736149:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919551.740620:0:6446:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790919551.742340:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742388:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742402:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742450:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742458:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742466:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742472:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919551.742478:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742486:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742501:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:3.0:1790919551.742504:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919551.742515:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742522:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914405 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919551.742542:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099f55d21 reply state 0000000076873950 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742562:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742569:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:3.0:1790919551.742572:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919551.742575:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790919551.742622:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159143fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 42 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742641:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 41 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.742648:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919551.742651:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919551.742653:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166da00, rc 0) 00000100:00100000:3.0:1790919551.742756:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+42:12538:x1877914958260608:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7051us (7264us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1790919551.742767:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:1.0:1790919551.749106:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919551.749282:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958260736 00000100:00100000:3.0:1790919551.749296:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958260736 00000100:00100000:3.0:1790919551.749390:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1790919551.749402:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958260736:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1790919551.749428:0:8083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919551.749454:0:8083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ee7 expref: -99 pid: 8083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919551.749490:0:8083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919551.749535:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1790919551.749546:0:8083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919551.749560:0:8083:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 6 pid: 8083 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.749583:0:8083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 6 pid: 8083 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.749598:0:8083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d400, rc 0) 00000100:00100000:3.0:1790919551.749677:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2414:x1877914958260736:12345-192.168.203.11@tcp:101:bash.0 Request processed in 277us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919551.749685:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00080000:2.0:1790919551.749808:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919551.758145:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.758452:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958260864 00000100:00100000:0.0:1790919551.758467:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958260864 00000100:00100000:0.0:1790919551.758551:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1790919551.758565:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:12538:x1877914958260864:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1790919551.758591:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919551.758615:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38eee expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.758655:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 7 pid: 8083 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.758666:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919551.758671:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919551.758678:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.758723:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 7 pid: 8083 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.758741:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 7 pid: 8083 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.758757:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8248:1877914978228608:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919551.758898:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919551.762803:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.762854:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8248:1877914978228608:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919551.762878:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958260992 00010000:00010000:0.0:1790919551.762896:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919551.762902:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958260992 00010000:00010000:0.0:1790919551.762922:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014a00, rc 0) 00010000:00010000:3.0:1790919551.762957:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 8 pid: 8083 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.763003:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:12538:x1877914958260864:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4439us (4870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.763018:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1790919551.763119:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:3.0:1790919551.763144:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958260992:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919551.763171:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919551.763201:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 7 pid: 8083 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.763218:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 7 pid: 8083 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.763271:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c4a6a07/0x951c50ad15914421 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee7 expref: 7 pid: 8083 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.763291:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919551.763297:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919551.763306:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 6 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.763998:0:6432:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 6 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919551.764290:0:6432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 6 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919551.764310:0:6432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6432:1877914978228736:192.168.203.11@tcp:105: 00000100:00100000:3.0:1790919551.764425:0:6432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2857980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919551.768628:0:6432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6432:1877914978228736:192.168.203.11@tcp:105: 00010000:00010000:3.0:1790919551.768659:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919551.768728:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958260992:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5598us (5939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919551.768740:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:3.0:1790919551.769018:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919551.769473:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958261248 00000100:00100000:2.0:1790919551.769482:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958261248 00000100:00100000:2.0:1790919551.769530:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1790919551.769540:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+42:12538:x1877914958261248:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1790919551.769973:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:12538:x1877914958261248:12345-192.168.203.11@tcp:35:bash.0 Request processed in 433us (954us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1790919551.769998:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1790919551.900272:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978228992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919551.900367:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919551.900396:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978229248:0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.900410:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978229376:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.900438:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919551.900457:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978228864:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.900469:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978229760:0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.900497:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919551.900510:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919551.900546:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978229504:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.900547:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978230272:0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.900585:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919551.900592:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978229120:0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.900611:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978230016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.900633:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919551.900643:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919551.900659:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978229632:0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.900670:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978230528:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.900690:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919551.900703:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919551.900715:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978230144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.900747:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919551.900781:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229248 00000100:00100000:0.0:1790919551.900788:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229248 00000100:00100000:0.0:1790919551.900828:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790919551.900838:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978229248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.900953:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919551.900975:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978229888:0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.900999:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919551.901015:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978230400:0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.901047:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919551.901099:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229760 00000100:00100000:2.0:1790919551.901104:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229760 00000100:00100000:2.0:1790919551.901135:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229504 00000100:00100000:2.0:1790919551.901138:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229504 00000100:00100000:2.0:1790919551.901186:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229120 00000100:00100000:2.0:1790919551.901190:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229120 00000100:00100000:2.0:1790919551.901199:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229632 00000100:00100000:2.0:1790919551.901202:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229632 00000100:00100000:2.0:1790919551.901213:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978230144 00000100:00100000:2.0:1790919551.901215:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978230144 00000100:00100000:2.0:1790919551.901228:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790919551.901234:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978229760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.901292:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978229760:12345-0@lo:400:kworker.0 Request processed in 57us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.901299:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790919551.901326:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790919551.901332:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978229504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.901396:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978229504:12345-0@lo:400:kworker.0 Request processed in 63us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.901404:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1790919551.901411:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978229248:12345-0@lo:400:kworker.0 Request processed in 573us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.901418:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1790919551.901422:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790919551.901430:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978229120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.901441:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229376 00000100:00100000:0.0:1790919551.901445:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229376 00000100:00100000:0.0:1790919551.901464:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790919551.901470:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978229120:12345-0@lo:400:kworker.0 Request processed in 43us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.901472:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978229376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.901480:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790919551.901495:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790919551.901503:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.901536:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978229632:12345-0@lo:400:kworker.0 Request processed in 34us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.901541:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790919551.901552:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1790919551.901558:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978230144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.901581:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978230144:12345-0@lo:400:kworker.0 Request processed in 24us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.901586:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1790919551.901601:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919551.901605:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919551.901619:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978229376:12345-0@lo:400:kworker.0 Request processed in 147us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.901626:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790919551.901645:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978228864 00000100:00100000:2.0:1790919551.901651:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978228864 00000100:00100000:0.0:1790919551.901657:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978230016 00000100:00100000:0.0:1790919551.901663:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978230016 00000100:00100000:2.0:1790919551.901680:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1790919551.901695:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978230528 00000100:00100000:0.0:1790919551.901699:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978230528 00000100:00100000:0.0:1790919551.901713:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978229888 00000100:00100000:0.0:1790919551.901716:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978229888 00000100:00100000:0.0:1790919551.901726:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978230400 00000100:00100000:0.0:1790919551.901728:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978230400 00000100:00100000:0.0:1790919551.901741:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790919551.901745:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978230016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.901775:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b58bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978230016:12345-0@lo:400:kworker.0 Request processed in 29us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.901780:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790919551.901802:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978228864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.901824:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978228992 00000100:00100000:3.0:1790919551.901829:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978228992 00000100:00100000:2.0:1790919551.901839:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978228864:12345-0@lo:400:kworker.0 Request processed in 152us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.901851:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1790919551.901855:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790919551.901860:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978228992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919551.901884:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919551.901980:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978228992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919551.901987:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790919551.902005:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790919551.902214:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978230528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.902249:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978230528:12345-0@lo:400:kworker.0 Request processed in 40us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919551.902291:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919551.902363:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978229248:0@lo:400:kworker.0 00010000:00080000:1.0:1790919551.902379:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c0d880 x1877914978229760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919551.902390:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978229760:0@lo:400:kworker.0 00000100:00100000:1.0:1790919551.902571:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978230272 00000100:00100000:1.0:1790919551.902576:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978230272 00000100:00100000:1.0:1790919551.902603:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790919551.902608:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978230272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919551.902655:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978230272:12345-0@lo:400:kworker.0 Request processed in 46us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919551.902660:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:1.0:1790919551.902680:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c0d500 x1877914978230272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919551.902699:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978230272:0@lo:400:kworker.0 00000100:00100000:2.0:1790919551.903019:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790919551.903041:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790919551.903044:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978229888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.903063:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978230400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903071:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790919551.903097:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978230400:12345-0@lo:400:kworker.0 Request processed in 47us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.903097:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978229888:12345-0@lo:400:kworker.0 Request processed in 55us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919551.903104:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1790919551.903115:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919551.903119:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919551.903121:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919551.903135:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978230656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919551.903168:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919551.903202:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978228864:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903207:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978229120:0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.903223:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978229504:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903227:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978229632:0@lo:400:kworker.0 00000100:00100000:3.0:1790919551.903244:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978230016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903247:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978230144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903280:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978230656 00000100:00100000:0.0:1790919551.903283:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978230656 00000100:00100000:0.0:1790919551.903305:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790919551.903322:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978230656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919551.903334:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919551.903351:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1790919551.903359:0:3460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000100:00100000:0.0:1790919551.903367:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978230656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919551.903375:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000004:00080000:3.0:1790919551.903385:0:3460:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f2839ae680, transno 4294967308 00000100:00100000:3.0:1790919551.903400:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978230528:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903408:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978230656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919551.903443:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978229376:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903454:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978229888:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903465:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978230400:0@lo:400:kworker.0 00000100:00100000:0.0:1790919551.903477:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978228992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919551.904324:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790919551.929175:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.929476:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958261376 00000100:00100000:1.0:1790919551.929492:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958261376 00000100:00100000:1.0:1790919551.929565:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:1.0:1790919551.929575:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+43:12554:x1877914958261376:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919551.929600:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919551.929792:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad1591442f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38ef5 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.929861:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914436 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.929875:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.929887:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919551.929921:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790919551.929925:0:7785:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919551.929944:0:7785:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.929982:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad1591442f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ef5 expref: 45 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.930002:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ef5 expref: 44 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.930012:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919551.930015:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919551.930019:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1da00, rc 0) 00000100:00100000:1.0:1790919551.930229:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:12554:x1877914958261376:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 654us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919551.930236:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:1.0:1790919551.940138:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.940269:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958261632 00000100:00100000:0.0:1790919551.940280:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958261632 00000100:00100000:0.0:1790919551.940368:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:0.0:1790919551.940378:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+44:12554:x1877914958261632:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919551.940401:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919551.940422:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad1591443d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38efc expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.940522:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914444 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.940537:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.940548:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919551.940558:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790919551.940673:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad1591443d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38efc expref: 47 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.940702:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914444 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38efc expref: 46 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.940710:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919551.940713:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919551.940716:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015c00, rc 0) 00000100:00100000:0.0:1790919551.940780:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+46:12554:x1877914958261632:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 404us (653us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1790919551.940787:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:2.0:1790919551.950685:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919551.950745:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919551.951399:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958261760 00000100:00100000:1.0:1790919551.951410:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958261760 00000100:00100000:1.0:1790919551.951469:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790919551.951479:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+46:2414:x1877914958261760:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919551.951499:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919551.951534:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914444 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38efc expref: 46 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919551.951553:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:1.0:1790919551.951558:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919551.951619:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+45:2414:x1877914958261760:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 141us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919551.951627:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790919551.951951:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262016 00000100:00100000:0.0:1790919551.951963:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262016 00000100:00100000:0.0:1790919551.951994:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:0.0:1790919551.952002:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+45:12554:x1877914958262016:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919551.952022:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919551.952038:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914452 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f03 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.952155:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914459 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.952168:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.952177:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919551.952189:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790919551.952300:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914452 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f03 expref: 48 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.952325:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914459 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f03 expref: 47 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.952332:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919551.952336:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790919551.952338:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380031a00, rc 0) 00000100:00100000:0.0:1790919551.952373:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+47:12554:x1877914958262016:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 372us (1626us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1790919551.952381:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:1.0:1790919551.959739:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.961967:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262144 00000100:00100000:0.0:1790919551.961981:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262144 00000100:00100000:0.0:1790919551.962064:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790919551.962073:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+6:2413:x1877914958262144:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:0.0:1790919551.962260:0:8084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.962281:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 6 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.962290:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919551.962294:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919551.962299:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.962345:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 6 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.962360:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 6 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.962375:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978230784:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919551.962460:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919551.965255:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.965428:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8084:1877914978230784:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919551.965454:0:8084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919551.965560:0:8088:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262272 00000100:00100000:2.0:1790919551.965567:0:8088:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262272 00002000:00100000:2.0:1790919551.965617:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff95f285eb9c00 x1877914958262272/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:672/0 lens 504/0 e 0 to 0 dl 1790919562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919551.965627:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f285eb9c00 with x1877914958262272 ext(0->8) 00010000:00010000:2.0:1790919551.965642:0:8088:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 7 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.965655:0:8088:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 7 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919551.965664:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f285eb9c00 00000100:00100000:2.0:1790919551.965691:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790919551.965700:0:8088:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958262272:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:2.0:1790919551.966253:0:8088:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958262272:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 553us (1004us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790919551.966262:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:2.0:1790919551.966275:0:8088:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff95f285eb9c00 x1877914958262272/t4294967309(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:672/0 lens 504/448 e 0 to 0 dl 1790919562 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790919551.966284:0:8088:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f285eb9c00 with x1877914958262272 ext(0->8) 00010000:00010000:2.0:1790919551.966290:0:8088:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 9 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.966302:0:8088:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 9 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919551.966309:0:8088:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95f285eb9c00 00000100:00100000:2.0:1790919551.981413:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.982384:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262400 00000100:00100000:0.0:1790919551.982394:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262400 00010000:00010000:0.0:1790919551.982437:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 9 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.982519:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:0.0:1790919551.982529:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2411:x1877914958262400:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919551.982544:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790919551.982562:0:6431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790919551.982565:0:6431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790919552 00002000:00010000:0.0:1790919551.982568:0:6431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790919552 00002000:00010000:0.0:1790919551.982570:0:6431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790919552 00010000:00010000:0.0:1790919551.982577:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 9 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.982590:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 9 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.982614:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b0d3ad2/0x951c50ad15914428 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eee expref: 9 pid: 8248 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.982638:0:6431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1790919551.982642:0:6431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919551.982648:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.982676:0:6431:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.982719:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919551.982781:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2411:x1877914958262400:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 254us (1376us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919551.982877:0:8084:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982887:0:8084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982910:0:8084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982918:0:8084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982927:0:8084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982944:0:8084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919551.982949:0:8084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982964:0:8084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982977:0:8084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.982985:0:8084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000538f7c9/0x951c50ad15914467 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919551.983039:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958262144:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 20966us (23306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.983047:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790919551.983300:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1790919551.987582:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919551.991495:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262656 00000100:00100000:2.0:1790919551.991509:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262656 00000100:00100000:2.0:1790919551.991624:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1790919551.991634:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390322850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+47:12554:x1877914958262656:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:2.0:1790919551.991697:0:6449:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914459 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f03 expref: 47 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919551.991942:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1790919551.991985:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1790919551.992325:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1790919551.992663:0:6449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.992677:0:6449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 51 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.992686:0:6449:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.992869:0:6449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 51 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.992883:0:6449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 51 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919551.992898:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6449:1877914978230912:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919551.992983:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919551.997531:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919551.997752:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262784 00000100:00100000:0.0:1790919551.997762:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262784 00010000:00010000:0.0:1790919551.997801:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 52 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.997839:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:0.0:1790919551.997848:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+52:2413:x1877914958262784:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919551.997862:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919551.997868:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 52 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.997881:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 52 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.997902:0:13233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919551.997908:0:13233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.997927:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.997948:0:13233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919551.997966:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919551.998004:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad15914413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ee0 expref: 52 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919551.998022:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+51:2413:x1877914958262784:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 175us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919551.998023:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6449:1877914978230912:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919551.998029:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00010000:00010000:2.0:1790919551.998042:0:6449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.998049:0:6449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919551.998558:0:6449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919551.998678:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1790919551.999633:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1790919551.999741:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978231040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790919552.000104:0:6449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919552.000138:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70540 going to sleep for 10 seconds 00000100:00100000:0.0:1790919552.000472:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978231040 00000100:00100000:0.0:1790919552.000479:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978231040 00000100:00100000:0.0:1790919552.000529:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790919552.000539:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6449:x1877914978231040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919552.000810:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6449:x1877914978231040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 272us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.000818:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790919552.000873:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978231040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790919552.001525:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1790919552.001584:0:6449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978231168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790919552.001620:0:6449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919552.001733:0:6449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919552.001821:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978231168 00000100:00100000:0.0:1790919552.001827:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978231168 00000100:00100000:0.0:1790919552.001887:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790919552.001896:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6449:x1877914978231168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790919552.002081:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6449:x1877914978231168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (459us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790919552.002088:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790919552.002176:0:6449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6449:1877914978231168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790919552.002221:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1790919552.002258:0:6449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.002446:0:6449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.002454:0:6449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.002461:0:6449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919552.002465:0:6449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.002473:0:6449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.002486:0:6449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919552.002489:0:6449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790919552.002493:0:6449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.002500:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591446e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919552.002982:0:6449:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790919552.003090:0:6449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1790919552.003102:0:6449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361031048948ns, next at 362031046434ns, rc = 0 00000001:00080000:3.0:1790919552.003153:0:6449:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1790919552.003192:0:6449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919552.003195:0:6449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790919552.003203:0:6449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914459 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f03 expref: 55 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919552.003460:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390322850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:12554:x1877914958262656:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 11827us (15885us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1790919552.003470:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000020:00080000:3.0:1790919552.003474:0:6449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790919552.006540:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.006710:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958262912 00000100:00100000:0.0:1790919552.006970:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958262912 00000100:00100000:0.0:1790919552.007027:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:0.0:1790919552.007038:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+54:12554:x1877914958262912:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919552.007419:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919552.007457:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914475 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f0a expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.007516:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914475 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f0a expref: 55 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.007529:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914475 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f0a expref: 55 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.007548:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919552.007551:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919552.007554:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030200, rc 0) 00000100:00100000:0.0:1790919552.007649:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+55:12554:x1877914958262912:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 612us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.007656:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:1.0:1790919552.011576:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.011701:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958263168 00000100:00100000:3.0:1790919552.012015:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958263168 00000100:00100000:3.0:1790919552.013402:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790919552.013420:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+55:12554:x1877914958263168:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790919552.013652:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12554:x1877914958263168:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 238us (2084us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1790919552.013660:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1790919552.100196:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.100438:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958263296 00000100:00100000:0.0:1790919552.100451:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958263296 00000100:00100000:0.0:1790919552.100589:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:0.0:1790919552.100602:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12564:x1877914958263296:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1790919552.100710:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.100733:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.100748:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.100762:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.100794:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.100802:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101121:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101141:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101149:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919552.101207:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101222:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101230:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101237:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101244:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380031a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919552.101249:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101256:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101274:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919552.101276:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919552.101288:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101293:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591447c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101341:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101348:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101417:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101423:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919552.101426:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101433:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101443:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:0.0:1790919552.101445:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919552.101448:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101455:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101478:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101485:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101491:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101496:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919552.101499:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101505:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101513:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919552.101515:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919552.101518:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.101525:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad1591448a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.101626:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12564:x1877914958263296:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1025us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.101635:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:1.0:1790919552.130868:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.131185:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958263552 00000100:00100000:2.0:1790919552.131198:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958263552 00000100:00100000:2.0:1790919552.131274:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:2.0:1790919552.131559:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+56:12567:x1877914958263552:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919552.131587:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.131612:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914491 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f11 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131716:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131734:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131747:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131779:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131787:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131793:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131933:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131941:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.131946:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919552.131957:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790919552.132272:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132289:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132296:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132303:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919552.132308:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132339:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132353:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919552.132356:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919552.132362:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132368:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad15914498 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132384:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132390:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132397:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132403:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919552.132405:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132411:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132418:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:2.0:1790919552.132421:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919552.132424:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132439:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad1591449f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132481:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad15914491 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 59 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132495:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 58 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.132502:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919552.132505:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919552.132507:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696000, rc 0) 00000100:00100000:2.0:1790919552.132588:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:12567:x1877914958263552:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1035us (1733us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1790919552.132596:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:1.0:1790919552.136223:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.136330:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958263680 00000100:00100000:3.0:1790919552.136344:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958263680 00000100:00100000:3.0:1790919552.136457:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1790919552.136470:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:12567:x1877914958263680:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1790919552.136563:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136602:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136616:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136653:0:7785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136661:0:7785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136669:0:7785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136676:0:7785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919552.136681:0:7785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136690:0:7785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136702:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:3.0:1790919552.136706:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919552.136712:0:7785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.136718:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad159144b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919552.136815:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:12567:x1877914958263680:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 348us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919552.136830:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:1.0:1790919552.139550:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.139795:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958263936 00000100:00100000:2.0:1790919552.139806:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958263936 00000100:00100000:2.0:1790919552.139865:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:2.0:1790919552.139875:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+58:12567:x1877914958263936:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919552.140421:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:12567:x1877914958263936:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 544us (880us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1790919552.140430:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1790919552.216828:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.216963:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958264192 00000100:00100000:2.0:1790919552.216978:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958264192 00000100:00100000:2.0:1790919552.217097:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:2.0:1790919552.217108:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:12577:x1877914958264192:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919552.217173:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.217177:0:6447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790919552.217213:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1da00/0x951c50ad15914436 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ef5 expref: 59 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.217239:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919552.217245:0:6447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919552.217261:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159144bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f18 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.217416:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.217432:0:6447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 59 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.217441:0:6447:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.217482:0:6447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 59 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.217497:0:6447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 59 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919552.217512:0:6447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978231296:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919552.217610:0:6447:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919552.221630:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.222166:0:6447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6447:1877914978231296:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919552.222223:0:6447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919552.222577:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958264320 00000100:00100000:3.0:1790919552.222588:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958264320 00010000:00010000:3.0:1790919552.222637:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 60 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919552.222741:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:3.0:1790919552.222752:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+60:2414:x1877914958264320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919552.222772:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919552.222780:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 60 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.222794:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 60 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.222821:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad159144a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f11 expref: 60 pid: 6446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.222844:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:3.0:1790919552.222849:0:6430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.222861:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.222870:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.222919:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919552.222999:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:2414:x1877914958264320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 247us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919552.223007:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00010000:00010000:2.0:1790919552.223086:0:6447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.223095:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919552.223920:0:6447:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790919552.224182:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697800/0x951c50ad159144bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 60 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.224206:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 59 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.224214:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919552.224217:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790919552.224220:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3c204ae00, rc 0) 00000100:00100000:2.0:1790919552.224278:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:12577:x1877914958264192:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7171us (7464us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790919552.224287:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:1.0:1790919552.227634:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.227728:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958264576 00000100:00100000:2.0:1790919552.227740:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958264576 00000100:00100000:2.0:1790919552.227814:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:2.0:1790919552.227826:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+59:12577:x1877914958264576:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1790919552.228441:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.228486:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.228500:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919552.228566:0:6446:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1790919552.228593:0:6446:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002978aad8 reply state 0000000075840aa9 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.228606:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.228613:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919552.228616:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919552.228620:0:6446:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919552.228840:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:12577:x1877914958264576:12345-192.168.203.11@tcp:36:bash.0 Request processed in 1014us (1218us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790919552.228849:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 218 00000020:00080000:2.0:1790919552.228855:0:6446:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919552.231295:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.231381:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958264704 00000100:00100000:2.0:1790919552.231392:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958264704 00000100:00100000:2.0:1790919552.231455:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:2.0:1790919552.231467:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:12577:x1877914958264704:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919552.231495:0:6445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.231519:0:6445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159144d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f1f expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.231636:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.231656:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 63 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.231666:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.231707:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 63 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.231731:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 63 pid: 6447 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919552.231749:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978231424:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919552.231846:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919552.234729:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978231424:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919552.234767:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.235173:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919552.235359:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958264832 00000100:00100000:1.0:1790919552.235369:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958264832 00010000:00010000:1.0:1790919552.235417:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 64 pid: 6447 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919552.235460:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:1.0:1790919552.235470:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:2413:x1877914958264832:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919552.235488:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919552.235496:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 64 pid: 6447 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.235513:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 64 pid: 6447 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.235537:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204ae00/0x951c50ad159144c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f18 expref: 64 pid: 6447 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.235556:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919552.235579:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.235591:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.235598:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.235632:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919552.235834:0:6445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.235844:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919552.235903:0:6445:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790919552.235908:0:6445:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919552.235932:0:6445:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.235985:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204aa00/0x951c50ad159144d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 64 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.236004:0:6445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 63 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.236012:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919552.236015:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919552.236018:0:6445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee600, rc 0) 00000100:00100000:1.0:1790919552.236153:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+63:2413:x1877914958264832:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 683us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919552.236163:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:2.0:1790919552.236280:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:12577:x1877914958264704:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4815us (4996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.236288:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:1.0:1790919552.239953:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.240457:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958265088 00000100:00100000:3.0:1790919552.240472:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958265088 00000100:00100000:3.0:1790919552.240549:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790919552.240560:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+62:12577:x1877914958265088:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:3.0:1790919552.240996:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+63:12577:x1877914958265088:12345-192.168.203.11@tcp:35:bash.0 Request processed in 437us (1055us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1790919552.241006:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790919552.309539:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.312342:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958265216 00000100:00100000:0.0:1790919552.312384:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958265216 00000100:00100000:0.0:1790919552.312544:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:0.0:1790919552.312556:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+63:12583:x1877914958265216:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919552.312590:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919552.312617:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159144e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f26 expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.312700:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159144ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.312728:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159144ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.312742:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159144ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919552.312796:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790919552.312801:0:13325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919552.312823:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159144ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.312852:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad159144e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f26 expref: 65 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.313127:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159144ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f26 expref: 64 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.313139:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919552.313142:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919552.313147:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015e00, rc 0) 00000100:00100000:0.0:1790919552.313404:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b658f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:12583:x1877914958265216:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 848us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.313413:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:1.0:1790919552.316945:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.317185:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958265344 00000100:00100000:0.0:1790919552.317200:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958265344 00000100:00100000:0.0:1790919552.317288:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:0.0:1790919552.317301:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:12583:x1877914958265344:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919552.317344:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919552.317377:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159144f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f2d expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317476:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317497:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317511:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317524:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317531:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317538:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317660:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317688:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.317696:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919552.317742:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790919552.318206:0:10757:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919552.320170:0:10757:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320197:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320208:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320215:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320222:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320293:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919552.320298:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320337:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320354:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919552.320357:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919552.320363:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320370:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad159144fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320390:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320397:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320403:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320408:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919552.320411:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320417:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320424:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:1.0:1790919552.320427:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919552.320430:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320445:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914501 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320496:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad159144f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 66 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320511:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 65 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.320519:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919552.320521:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919552.320524:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380031a00, rc 0) 00000100:00100000:1.0:1790919552.320681:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12583:x1877914958265344:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 3382us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919552.320692:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:1.0:1790919552.328859:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919552.328964:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.329107:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958265728 00000100:00100000:0.0:1790919552.329121:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958265728 00000100:00100000:0.0:1790919552.329192:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1790919552.329203:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12583:x1877914958265728:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919552.329240:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919552.329270:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591450f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f34 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329451:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329471:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 66 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329479:0:7785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 66 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329488:0:7785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329541:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 66 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329567:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 66 pid: 10757 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.329583:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978231552:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919552.329693:0:7785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 66 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.329702:0:7785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 66 pid: 6445 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.329728:0:7785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978231680:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919552.329755:0:7785:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919552.330942:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958265472 00000100:00100000:3.0:1790919552.330955:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958265472 00010000:00010000:3.0:1790919552.331041:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 67 pid: 10757 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919552.331106:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:3.0:1790919552.331117:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:2411:x1877914958265472:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919552.331133:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919552.331140:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 67 pid: 10757 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.331154:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 67 pid: 10757 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.331197:0:6432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:3.0:1790919552.331203:0:6432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.331213:0:6432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.331220:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919552.331516:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:2411:x1877914958265472:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 390us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919552.331525:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1790919552.334818:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.334918:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958265856 00000100:00100000:2.0:1790919552.334931:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958265856 00010000:00010000:2.0:1790919552.334984:0:7709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 67 pid: 6445 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919552.335042:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:2.0:1790919552.335071:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:2413:x1877914958265856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919552.335091:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919552.335099:0:7709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 67 pid: 6445 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.335113:0:7709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 67 pid: 6445 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.335165:0:7709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919552.335170:0:7709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.335181:0:7709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.335189:0:7709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.335211:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919552.335294:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:2413:x1877914958265856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 241us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.335303:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00010000:00010000:0.0:1790919552.336827:0:7785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.11@tcp) returned -22 from blocking AST (req@000000009473b707 x1877914978231552) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 66 pid: 10757 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.336853:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f2d expref: 66 pid: 10757 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.336876:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978231552:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919552.336897:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee600/0x951c50ad159144de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f1f expref: 65 pid: 6445 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.336910:0:7785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7785:1877914978231680:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919552.336963:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919552.336971:0:7785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.336982:0:7785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.336990:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919552.337144:0:7785:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790919552.337377:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591450f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 66 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.337396:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 65 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.337405:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919552.337408:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919552.337410:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014c00, rc 0) 00000100:00100000:0.0:1790919552.337485:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12583:x1877914958265728:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 8283us (8519us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1790919552.337495:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:1.0:1790919552.342299:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.342469:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958266112 00000100:00100000:0.0:1790919552.342483:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958266112 00000100:00100000:0.0:1790919552.342572:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790919552.342583:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12583:x1877914958266112:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:0.0:1790919552.342604:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919552.342655:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914475 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f0a expref: 65 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.342680:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919552.342684:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919552.342778:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:12583:x1877914958266112:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 197us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.342786:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790919552.346689:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.346964:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958266240 00000100:00100000:2.0:1790919552.346977:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958266240 00000100:00100000:2.0:1790919552.347151:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:2.0:1790919552.347164:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:12583:x1877914958266240:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:2.0:1790919552.347453:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.347476:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.347489:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919552.348187:0:6447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1790919552.351502:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:12583:x1877914958266240:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 3726us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.351546:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:2.0:1790919552.359688:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919552.361864:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958266368 00000100:00100000:1.0:1790919552.361885:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958266368 00000100:00100000:1.0:1790919552.362100:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:1.0:1790919552.362113:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+64:12583:x1877914958266368:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919552.362142:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919552.362169:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f3b expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.362277:0:6446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.362290:0:6446:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 65 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.362322:0:6446:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.362336:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 65 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.362353:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919552.362356:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919552.362361:0:6446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 65 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919552.362369:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c600, rc 0) 00000100:00100000:1.0:1790919552.362457:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12583:x1877914958266368:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 346us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919552.362464:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 224 00010000:00010000:2.0:1790919552.412466:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919552.860296:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790919552.860314:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919552.860369:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1790919552.860376:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919552.860501:0:13302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978231808:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919552.860595:0:13302:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919552.869752:0:13302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978231808:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919552.870217:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.870344:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958266496 00000100:00100000:0.0:1790919552.870354:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958266496 00000100:00100000:0.0:1790919552.870425:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:0.0:1790919552.870436:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12584:x1877914958266496:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919552.870478:0:6445:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919552.870617:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12584:x1877914958266496:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 182us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.870625:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:1.0:1790919552.876697:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.876833:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958266624 00000100:00100000:0.0:1790919552.876846:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958266624 00000100:00100000:0.0:1790919552.876925:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:0.0:1790919552.876937:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12584:x1877914958266624:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790919552.877255:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877280:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877293:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877387:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877401:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877409:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877439:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877450:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877457:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919552.877505:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790919552.877510:0:13325:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919552.877525:0:13325:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877538:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877616:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877624:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877631:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919552.877637:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877645:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877659:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:0.0:1790919552.877662:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919552.877668:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877675:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015c00/0x951c50ad15914532 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877690:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877697:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877703:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877708:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919552.877717:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877724:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877732:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff95f382b81100) 00010000:00010000:0.0:1790919552.877735:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919552.877738:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877744:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914539 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877762:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877768:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877774:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877779:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919552.877782:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877788:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877796:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919552.877798:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919552.877809:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.877816:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914540 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.878042:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12584:x1877914958266624:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 1104us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.878145:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:1.0:1790919552.883959:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.884561:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958266880 00000100:00100000:2.0:1790919552.884575:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958266880 00000100:00100000:2.0:1790919552.884740:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:2.0:1790919552.884752:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+65:12584:x1877914958266880:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919552.884779:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.884805:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914547 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f42 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.884932:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.884951:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.884965:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919552.884978:0:10757:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790919552.885128:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885137:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885146:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885173:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860efc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919552.885179:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885188:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885203:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919552.885206:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919552.885211:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885217:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efc00/0x951c50ad1591454e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885269:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914547 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f42 expref: 67 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885278:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919552.885280:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919552.885284:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914547 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f42 expref: 67 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.885293:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee000, rc 0) 00000100:00100000:2.0:1790919552.885398:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:12584:x1877914958266880:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 648us (1454us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1790919552.885407:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:2.0:1790919552.890282:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.890446:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958267008 00000100:00100000:0.0:1790919552.890460:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958267008 00000100:00100000:0.0:1790919552.890543:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:0.0:1790919552.890555:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:12584:x1877914958267008:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790919552.890606:0:6445:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790919552.890750:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:12584:x1877914958267008:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 196us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.890759:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:0.0:1790919552.895478:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.895641:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958267264 00000100:00100000:2.0:1790919552.895655:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958267264 00000100:00100000:2.0:1790919552.895763:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:2.0:1790919552.895776:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:12584:x1877914958267264:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919552.895804:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.895808:0:6447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790919552.895842:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015e00/0x951c50ad159144ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f26 expref: 66 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.895879:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919552.895885:0:6447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919552.895902:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad1591455c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f49 expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790919552.897013:0:6447:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1790919552.898117:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914563 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.898141:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.898155:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.898235:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad1591455c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f49 expref: 68 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.898257:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f49 expref: 67 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.898291:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f39314a200) 00010000:00010000:2.0:1790919552.898295:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919552.898299:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef800, rc 0) 00000100:00100000:2.0:1790919552.899090:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:12584:x1877914958267264:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3280us (3590us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790919552.899103:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:1.0:1790919552.905333:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.905486:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958267520 00000100:00100000:2.0:1790919552.905499:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958267520 00000100:00100000:2.0:1790919552.905572:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:2.0:1790919552.905584:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:12584:x1877914958267520:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919552.905666:0:6446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919552.905699:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914563 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f49 expref: 67 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.905738:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f39314a200) 00010000:00010000:2.0:1790919552.905751:0:6446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919552.905777:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.905794:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.905806:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912574:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912621:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912635:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912708:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912716:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912724:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912731:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919552.912736:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912744:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912757:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:2.0:1790919552.912760:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919552.912765:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912772:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad15914571 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912786:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912799:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912805:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912810:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919552.912813:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912820:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912955:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4859253b (ffff95f39314a600) 00010000:00010000:2.0:1790919552.912958:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919552.912962:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.912968:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914578 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4859253b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919552.913104:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:12584:x1877914958267520:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 7516us (7790us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919552.913114:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:1.0:1790919552.919013:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.919139:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958267648 00000100:00100000:3.0:1790919552.919154:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958267648 00000100:00100000:3.0:1790919552.919227:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:3.0:1790919552.919239:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+66:12584:x1877914958267648:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919552.919268:0:7785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919552.919298:0:7785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591457f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f50 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.919360:0:7785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.919378:0:7785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.919392:0:7785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.919541:0:7785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591457f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 68 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.919566:0:7785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 67 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.919576:0:7785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919552.919579:0:7785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919552.919583:0:7785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:3.0:1790919552.919669:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:12584:x1877914958267648:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 433us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919552.919677:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:0.0:1790919552.924504:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.924592:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958267904 00000100:00100000:2.0:1790919552.924610:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958267904 00000100:00100000:0.0:1790919552.925028:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:0.0:1790919552.925043:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+67:12584:x1877914958267904:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919552.925185:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.925208:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.925222:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919552.925852:0:13325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1790919552.925863:0:13325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361953809949ns, next at 362953807408ns, rc = 0 00000004:00010000:0.0:1790919552.925956:0:13325:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009473b707 reply state 000000004cd83919 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.925972:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.925981:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919552.925984:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790919552.925989:0:13325:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919552.926787:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+69:12584:x1877914958267904:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1741us (2290us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1790919552.926799:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:1.0:1790919552.931451:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.932158:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958268032 00000100:00100000:2.0:1790919552.932174:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958268032 00000100:00100000:2.0:1790919552.932259:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:2.0:1790919552.932270:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+69:12584:x1877914958268032:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919552.932425:0:10757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.932456:0:10757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f57 expref: -99 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.932541:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 70 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.932559:0:10757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 70 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.932583:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:2.0:1790919552.932587:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919552.932592:0:10757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef600, rc 0) 00000100:00100000:2.0:1790919552.932682:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+70:12584:x1877914958268032:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 413us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.932690:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:1.0:1790919552.938252:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.938538:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958268160 00000100:00100000:2.0:1790919552.938553:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958268160 00000100:00100000:2.0:1790919552.938693:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:2.0:1790919552.938909:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2413:x1877914958268160:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790919552.939553:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:2413:x1877914958268160:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 846us (1311us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1790919552.939563:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1790919552.943298:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.943482:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958268416 00000100:00100000:2.0:1790919552.943497:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958268416 00000100:00100000:2.0:1790919552.943623:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790919552.943635:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+70:12584:x1877914958268416:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790919552.943998:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+71:12584:x1877914958268416:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 363us (724us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1790919552.944006:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1790919552.947704:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.947841:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958268672 00000100:00100000:3.0:1790919552.947853:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958268672 00000100:00100000:3.0:1790919552.947926:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:3.0:1790919552.947938:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+71:12584:x1877914958268672:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919552.948117:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+71:12584:x1877914958268672:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 181us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919552.948134:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:1.0:1790919552.951568:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.952019:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958268800 00000100:00100000:2.0:1790919552.952034:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958268800 00000100:00100000:2.0:1790919552.952158:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:2.0:1790919552.952170:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+71:12584:x1877914958268800:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919552.952203:0:6447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.952231:0:6447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad1591459b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f5e expref: -99 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.952365:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad159145a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.952384:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad159145a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.952397:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad159145a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919552.952444:0:6447:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919552.952468:0:6447:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad159145a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.952503:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee000/0x951c50ad1591459b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f5e expref: 73 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.952528:0:6447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad159145a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f5e expref: 72 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.952562:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:2.0:1790919552.952565:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790919552.952570:0:6447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef800, rc 0) 00000100:00100000:2.0:1790919552.952660:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+72:12584:x1877914958268800:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 492us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.952669:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:1.0:1790919552.956666:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.956966:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958268928 00000100:00100000:3.0:1790919552.956979:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958268928 00000100:00100000:3.0:1790919552.957217:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1790919552.957230:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+10:2414:x1877914958268928:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919552.957255:0:8082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919552.957295:0:8082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f65 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919552.957362:0:8082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf4381, blocks: 0x1 00010000:00010000:3.0:1790919552.957390:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1790919552.957395:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919552.957408:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 11 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.957431:0:8082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 11 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919552.957448:0:8082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d400, rc 0) 00000100:00100000:3.0:1790919552.957577:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2414:x1877914958268928:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 349us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919552.957585:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1790919552.961607:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.961867:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269184 00000100:00100000:2.0:1790919552.961881:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269184 00000100:00100000:2.0:1790919552.961956:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:2.0:1790919552.961969:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+72:12584:x1877914958269184:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790919552.962147:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+72:12584:x1877914958269184:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 180us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.962155:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:1.0:1790919552.966147:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919552.966325:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269312 00000100:00100000:2.0:1790919552.966338:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269312 00000100:00100000:2.0:1790919552.966418:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1790919552.966429:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:12584:x1877914958269312:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919552.966452:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919552.966475:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f6c expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.966512:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 12 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.966545:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919552.966550:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919552.966557:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 12 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.966602:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 12 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.966619:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 12 pid: 8082 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919552.966636:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8248:1877914978231936:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919552.966743:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919552.970356:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919552.970505:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269440 00000100:00100000:0.0:1790919552.970518:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269440 00010000:00010000:0.0:1790919552.970586:0:13233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 13 pid: 8082 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.970646:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:0.0:1790919552.970663:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2414:x1877914958269440:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919552.970683:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919552.970714:0:13233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 13 pid: 8082 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.970744:0:13233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 13 pid: 8082 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.970793:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919552.970807:0:13233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919552.970818:0:13233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 13 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.970828:0:13233:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 13 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919552.970878:0:13233:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 13 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919552.970898:0:13233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13233:1877914978232064:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790919552.971015:0:13233:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383eceb40 going to sleep for 11 seconds 00010000:00010000:2.0:1790919552.973135:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4a6a07/0x951c50ad159145a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f65 expref: 13 pid: 8082 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919552.973170:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8248:1877914978231936:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919552.973212:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 12 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919552.973232:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee000, rc 0) 00000100:00100000:2.0:1790919552.973346:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:12584:x1877914958269312:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 6917us (7221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919552.973381:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:0.0:1790919552.976466:0:13233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13233:1877914978232064:192.168.203.11@tcp:105: 00010000:00010000:0.0:1790919552.976503:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919552.977291:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2414:x1877914958269440:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6622us (6949us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919552.977318:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:1.0:1790919552.978135:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.978216:0:8089:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269568 00000100:00100000:3.0:1790919552.978228:0:8089:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269568 00002000:00100000:3.0:1790919552.978301:0:8089:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff95f285a99880 x1877914958269568/t0(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:673/0 lens 504/0 e 0 to 0 dl 1790919563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919552.978321:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f285a99880 with x1877914958269568 ext(0->12) 00002000:00010000:3.0:1790919552.978329:0:8089:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f285a99880 00000100:00100000:3.0:1790919552.978799:0:8089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790919552.978824:0:8089:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+11:2414:x1877914958269568:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790919552.979505:0:8089:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2414:x1877914958269568:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 679us (1368us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790919552.981913:0:8089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00002000:00100000:3.0:1790919552.981940:0:8089:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff95f285a99880 x1877914958269568/t4294967321(0) o4->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:673/0 lens 504/448 e 0 to 0 dl 1790919563 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919552.981954:0:8089:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f285a99880 with x1877914958269568 ext(0->12) 00002000:00010000:3.0:1790919552.981964:0:8089:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f285a99880 00000100:00100000:1.0:1790919552.983746:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919552.983843:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269696 00000100:00100000:3.0:1790919552.983855:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269696 00000100:00100000:3.0:1790919552.983927:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:3.0:1790919552.983938:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+72:12584:x1877914958269696:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790919553.038075:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1790919553.038092:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:2.0:1790919553.038147:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000020:00080000:2.0:1790919553.038172:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f3bc12bcc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790919553.038178:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f28425b000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f3bc12b9c0 00000020:00080000:2.0:1790919553.038182:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f28425bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f28578b400 00000004:00080000:2.0:1790919553.038204:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1790919553.038214:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f3bce70180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790919553.038216:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3b59c1f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f3bce70780 00000020:00080000:2.0:1790919553.038219:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3bdf64c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f3b5887400 00000004:00080000:2.0:1790919553.038237:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790919553.038281:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1790919553.038843:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1790919553.039405:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039419:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039441:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039447:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.039452:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039460:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039477:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff95f382b81b00) 00010000:00010000:0.0:1790919553.039480:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.039485:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039490:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad159142d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039532:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039539:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039545:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039550:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.039552:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039567:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039575:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff95f39314af00) 00010000:00010000:0.0:1790919553.039578:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.039581:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039588:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad1591436b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039607:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039613:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039618:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039622:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.039636:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039643:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039651:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:0.0:1790919553.039653:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.039656:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039669:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad159143e9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039685:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039690:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039696:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.039701:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.040185:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040198:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040207:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314a400) 00010000:00010000:0.0:1790919553.040209:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.040212:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040218:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591440c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040237:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040243:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040258:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040263:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.040265:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040271:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040285:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919553.040288:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.040291:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040298:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3c204b200/0x951c50ad159144d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040329:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040337:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040344:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040349:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380031a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.040352:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040369:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040378:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919553.040381:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790919553.040384:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.040390:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad1591458d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.042045:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12584:x1877914958269696:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 58100us (58301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919553.042231:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:1.0:1790919553.042493:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978232192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790919553.042542:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919553.042823:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978232320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790919553.042854:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919553.043115:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978232192 00000100:00100000:0.0:1790919553.043123:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978232192 00000100:00100000:0.0:1790919553.043179:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978232320 00000100:00100000:0.0:1790919553.043182:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978232320 00000100:00100000:0.0:1790919553.043205:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919553.043213:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978232192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790919553.043241:0:8084:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1790919553.043264:0:8084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.043283:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 12 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.043292:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790919553.043296:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919553.043300:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.043354:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 12 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.043369:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 12 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919553.043382:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8084:1877914978232448:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919553.043440:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383eceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919553.043529:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919553.043537:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3459:x1877914978232320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790919553.043676:0:8248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790919553.043680:0:8248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790919553 00002000:00010000:0.0:1790919553.043683:0:8248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790919553.043685:0:8248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790919553 -> 1790919553 00002000:00010000:0.0:1790919553.043687:0:8248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790919553.043728:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3459:x1877914978232320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (872us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1790919553.043735:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1790919553.043774:0:3459:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f2871a8700/2, rc 0, transno 4294967322 00000100:00100000:0.0:1790919553.043780:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978232320:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1790919553.043964:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919553.044374:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978232576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790919553.044411:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919553.044480:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978232576 00000100:00100000:2.0:1790919553.044486:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978232576 00000100:00100000:2.0:1790919553.044525:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790919553.044532:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978232576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790919553.044548:0:8248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1790919553.044571:0:8248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abf4380, atime: 0x6abf4380, ctime: 0x6abf4380, blocks: 0x1 00010000:00010000:2.0:1790919553.044578:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.044603:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1790919553.044607:0:8248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919553.044612:0:8248:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.044626:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.044635:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.044644:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.044660:0:8248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790919553.045186:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978232576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 652us (772us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790919553.045193:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1790919553.045472:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919553.045485:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.045494:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860efc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919553.045498:0:6433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.045508:0:6433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.045526:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.045533:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf8bcdd/0x951c50ad159145be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.045552:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919553.045554:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919553.045556:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919553.045563:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790919553.045592:0:3460:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f285aaaa00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1790919553.045597:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978232576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790919553.046416:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919553.046480:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269824 00000100:00100000:0.0:1790919553.046488:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269824 00000100:00100000:0.0:1790919553.046550:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1790919553.046560:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2414:x1877914958269824:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1790919553.047241:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919553.049111:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8084:1877914978232448:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919553.049152:0:8084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.049255:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919553.049279:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958269952 00000100:00100000:3.0:1790919553.049285:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958269952 00010000:00010000:3.0:1790919553.049327:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 14 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.049372:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1790919553.049381:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+14:2413:x1877914958269952:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919553.049408:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919553.049415:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 14 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049430:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 14 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049454:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020141ec2/0x951c50ad15914379 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ecb expref: 14 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049471:0:6430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919553.049475:0:6430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919553.049481:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049490:0:6430:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049512:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919553.049561:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+13:2413:x1877914958269952:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 181us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919553.049569:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00010000:00010000:3.0:1790919553.049690:0:8084:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049699:0:8084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049728:0:8084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049737:0:8084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.049753:0:8084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919553.051932:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919553.051946:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.051958:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919553.051962:0:6434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.051973:0:6434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.051991:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.051997:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159145b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.052033:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919553.052035:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919553.052037:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919553.056787:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3458:x1877914978232192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13566us (14235us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790919553.056811:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1790919553.057163:0:3458:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f2871a8000/2, rc 0, transno 4294967323 00000100:00100000:2.0:1790919553.057170:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978232192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790919553.085287:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+12:2414:x1877914958269824:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 38719us (38865us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919553.085301:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000001:00080000:3.0:1790919553.086634:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1790919553.086653:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1790919553.086660:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1790919553.086683:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1790919553.089143:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919553.089364:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958270208 00000100:00100000:0.0:1790919553.089388:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958270208 00000100:00100000:0.0:1790919553.089468:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:0.0:1790919553.089480:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12584:x1877914958270208:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790919553.089539:0:6447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919553.089575:0:6447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad159145a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f5e expref: 20 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.089599:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919553.089603:0:6447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919553.089634:0:6447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.089648:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.089658:0:6447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790919553.089818:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1790919553.090287:0:6447:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d06146d reply state 000000000d896ea5 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.090314:0:6447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.090322:0:6447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919553.090325:0:6447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790919553.090328:0:6447:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790919553.090450:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:12584:x1877914958270208:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 971us (1324us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1790919553.090458:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:0.0:1790919553.096180:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919553.096289:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958270336 00000100:00100000:1.0:1790919553.096299:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958270336 00000100:00100000:1.0:1790919553.096408:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1790919553.096418:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958270336:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790919553.096605:0:8082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790919553.096609:0:8082:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1790919553 -> 1790919552 00002000:00010000:1.0:1790919553.096612:0:8082:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790919552 00002000:00010000:1.0:1790919553.096614:0:8082:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790919553 -> 1790919552 00002000:00010000:1.0:1790919553.096616:0:8082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790919553.096676:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958270336:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 260us (504us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790919553.096684:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:3.0:1790919553.099263:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919553.099386:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958270592 00000100:00100000:2.0:1790919553.099396:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958270592 00000100:00100000:2.0:1790919553.099452:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:2.0:1790919553.099462:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:12584:x1877914958270592:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790919553.099526:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.099556:0:10757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 21 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.099567:0:10757:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.099603:0:10757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 21 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.099618:0:10757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 21 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919553.099633:0:10757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978232704:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919553.099934:0:10757:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919553.103510:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919553.103628:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958270720 00000100:00100000:1.0:1790919553.103635:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958270720 00000100:00100000:2.0:1790919553.103637:0:10757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10757:1877914978232704:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919553.103662:0:10757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.103670:0:6431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 22 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919553.103697:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:1.0:1790919553.103706:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:2413:x1877914958270720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919553.103736:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919553.103743:0:6431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 22 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.103754:0:6431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 22 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.103775:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c600/0x951c50ad15914586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f50 expref: 22 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.103792:0:6431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:1.0:1790919553.103959:0:6431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.103971:0:6431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.103979:0:6431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.104046:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919553.104143:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:2413:x1877914958270720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 438us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919553.104151:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00010000:00010000:2.0:1790919553.104207:0:10757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104215:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104242:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104250:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104263:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104269:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919553.104274:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104282:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104291:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:2.0:1790919553.104294:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790919553.104298:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.104314:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919553.104355:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12584:x1877914958270592:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 4894us (5099us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790919553.104363:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:0.0:1790919553.107827:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919553.107917:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958270848 00000100:00100000:3.0:1790919553.107926:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958270848 00000100:00100000:3.0:1790919553.107979:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1790919553.107989:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958270848:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790919553.108029:0:8084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.108048:0:8084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 8 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.108204:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790919553.108209:0:8084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919553.108214:0:8084:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.108251:0:8084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 8 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.108265:0:8084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 8 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.108279:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8084:1877914978232832:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919553.108419:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919553.111921:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919553.112032:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8084:1877914978232832:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919553.112084:0:8084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919553.112176:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958270976 00000100:00100000:1.0:1790919553.112183:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958270976 00010000:00010000:1.0:1790919553.112218:0:6432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 9 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919553.112278:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:1.0:1790919553.112287:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+9:2414:x1877914958270976:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919553.112301:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919553.112332:0:6432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 9 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.112344:0:6432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 9 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.112365:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071abca38/0x951c50ad159145b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f6c expref: 9 pid: 8248 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.112380:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919553.112385:0:6432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790919553.112390:0:6432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.112400:0:6432:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919553.112429:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919553.112452:0:8084:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112461:0:8084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112485:0:8084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919553.112485:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958270976:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919553.112492:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00010000:00010000:3.0:1790919553.112500:0:8084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112508:0:8084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112515:0:8084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166cc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919553.112519:0:8084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112528:0:8084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112540:0:8084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.112547:0:8084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eaa1f29/0x951c50ad159145d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.112589:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958270848:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 4602us (4771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919553.112597:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:0.0:1790919553.115523:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919553.115885:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958271232 00000100:00100000:2.0:1790919553.115894:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958271232 00000100:00100000:2.0:1790919553.115980:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:2.0:1790919553.115991:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:12584:x1877914958271232:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790919553.116101:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.116119:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.116421:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.116650:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.116662:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 21 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.116670:0:6445:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.116995:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 21 pid: 10757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.117015:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 21 pid: 10757 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919553.117029:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978232960:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919553.117402:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38325d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919553.124640:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919553.124695:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978232960:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919553.124731:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.124733:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958271360 00000100:00100000:3.0:1790919553.124740:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958271360 00010000:00010000:3.0:1790919553.124775:0:6430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 22 pid: 10757 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.124829:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:3.0:1790919553.124838:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:2414:x1877914958271360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919553.124854:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919553.124860:0:6430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 22 pid: 10757 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.124871:0:6430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 22 pid: 10757 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.124891:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef600/0x951c50ad15914594 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f57 expref: 22 pid: 10757 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.124907:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919553.124912:0:6430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.124922:0:6430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.124930:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.124957:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919553.125339:0:6445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.125348:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919553.125398:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:2414:x1877914958271360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 560us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919553.125406:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000001:00080000:0.0:1790919553.125518:0:6445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1790919553.125662:0:6445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1790919553.126186:0:6445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1790919553.126280:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6445:1877914978233088:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790919553.126360:0:6445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919553.126383:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386592000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919553.126443:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978233088 00000100:00100000:1.0:1790919553.126450:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978233088 00000100:00100000:1.0:1790919553.126496:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790919553.126504:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6445:x1877914978233088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790919553.126579:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6445:x1877914978233088:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919553.126586:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790919553.126697:0:6445:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1790919553.126760:0:6445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1790919553.126779:0:6445:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f2871a8700, transno 4294967322 00000100:00100000:0.0:1790919553.126914:0:6445:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff95f2871a8000 x1877914978232192/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790919569 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919553.126927:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6445:1877914978233088:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790919553.127404:0:6445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1790919553.127464:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6445:1877914978233216:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790919553.127502:0:6445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919553.127574:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919553.128289:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978233216 00000100:00100000:2.0:1790919553.128298:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978233216 00000100:00100000:2.0:1790919553.128547:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790919553.128557:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6445:x1877914978233216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790919553.129000:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2839aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6445:x1877914978233216:12345-0@lo:1000:mdt00_000.0 Request processed in 444us (1497us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790919553.129023:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790919553.129430:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6445:1877914978233216:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790919553.129471:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129481:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129489:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129495:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860eea00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.129500:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129508:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129522:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:0.0:1790919553.129525:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919553.129530:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129536:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eea00/0x951c50ad159145e1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129562:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129568:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129583:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129589:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860eee00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.129592:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129599:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129607:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919553.129609:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790919553.129616:0:6445:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 24 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129628:0:6445:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 24 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129637:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 24 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.129667:0:6445:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 24 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919553.129680:0:6445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978233344:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790919553.130075:0:6445:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919553.133455:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919553.133552:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958271488 00000100:00100000:3.0:1790919553.133576:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958271488 00000100:00100000:3.0:1790919553.133639:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1790919553.133650:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12583:x1877914958271488:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:3.0:1790919553.134033:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+25:12583:x1877914958271488:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 383us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919553.134042:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1790919553.134626:0:6445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6445:1877914978233344:192.168.203.11@tcp:105: 00010000:00010000:0.0:1790919553.134667:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.134678:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860eee00/0x951c50ad15914524 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.134764:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.134780:0:6445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.134791:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135475:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135483:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135490:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135495:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.135499:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135505:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135517:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919553.135519:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.135532:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135538:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad159145e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135549:0:6445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135555:0:6445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135561:0:6445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135566:0:6445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.135569:0:6445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135575:0:6445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135582:0:6445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919553.135585:0:6445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790919553.135587:0:6445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.135593:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef000/0x951c50ad159145da lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919553.139364:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919553.139372:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919553.139877:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790919553.139887:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919553.140197:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12584:x1877914958271232:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 24202us (24677us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790919553.140209:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000020:00080000:0.0:1790919553.140224:0:6445:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790919553.148415:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919553.148503:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958271744 00000100:00100000:3.0:1790919553.148512:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958271744 00000100:00100000:3.0:1790919553.148569:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:3.0:1790919553.148579:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12583:x1877914958271744:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:3.0:1790919553.148949:0:13325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1790919553.149035:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12583:x1877914958271744:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 457us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919553.149043:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:1.0:1790919553.151811:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919553.151986:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958272000 00000100:00100000:3.0:1790919553.151997:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958272000 00000100:00100000:3.0:1790919553.152049:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:3.0:1790919553.152081:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390322450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+24:12584:x1877914958272000:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790919553.152699:0:6448:0:(mdd_object.c:4180:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790919553.153219:0:6448:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1790919553.153264:0:6448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.153280:0:6448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.153291:0:6448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.153319:0:6448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.153325:0:6448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.153332:0:6448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919553.153438:0:6448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790919553.153534:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390322450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:12584:x1877914958272000:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1453us (1740us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1790919553.153543:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:3.0:1790919553.153548:0:6448:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790919553.154586:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919553.154597:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.154607:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166cc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919553.154611:0:7708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.154619:0:7708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.154634:0:7708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:2.0:1790919553.154637:0:7708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790919553.154642:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.154647:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166cc00/0x951c50ad159145ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.154663:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919553.154665:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919553.154667:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919553.194517:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919553.194624:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958272128 00000100:00100000:2.0:1790919553.194650:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958272128 00000100:00100000:2.0:1790919553.194835:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:2.0:1790919553.194845:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+26:12586:x1877914958272128:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919553.194869:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919553.194899:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efa00/0x951c50ad159145f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f73 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.194963:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.194977:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.194988:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.195003:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.195009:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.195015:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.196544:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.196564:0:6446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 27 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.196572:0:6446:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.196605:0:6446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 27 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.196620:0:6446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 27 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919553.196634:0:6446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2839ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6446:1877914978233472:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919553.196867:0:6446:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919553.199480:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919553.200495:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958272384 00000100:00100000:2.0:1790919553.200506:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958272384 00000100:00100000:2.0:1790919553.200573:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1790919553.200584:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:6383:x1877914958272384:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790919553.200834:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:6383:x1877914958272384:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 251us (1363us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1790919553.200856:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1790919553.201561:0:6446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2839ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6446:1877914978233472:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919553.201595:0:6446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919553.205644:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919553.205678:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958272512 00000100:00100000:2.0:1790919553.205687:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958272512 00010000:00010000:2.0:1790919553.205850:0:12731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 29 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919553.205893:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1790919553.205902:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:2413:x1877914958272512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919553.205916:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919553.205923:0:12731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 29 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.205936:0:12731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 29 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.205956:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014c00/0x951c50ad15914516 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f34 expref: 29 pid: 7785 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.205971:0:12731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919553.205976:0:12731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.205986:0:12731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.205994:0:12731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919553.206186:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919553.206234:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:2413:x1877914958272512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 333us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919553.206242:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00010000:00010000:0.0:1790919553.207537:0:6446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207551:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919553.207596:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790919553.207600:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919553.207618:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207630:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207653:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207661:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207668:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207673:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.207678:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207685:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207697:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:0.0:1790919553.207699:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.207703:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207709:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee200/0x951c50ad159145fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207723:0:6446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207730:0:6446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207735:0:6446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207745:0:6446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919553.207748:0:6446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207754:0:6446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207761:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff95f39314ae00) 00010000:00010000:0.0:1790919553.207764:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919553.207767:0:6446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207773:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ee800/0x951c50ad15914604 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207810:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efa00/0x951c50ad159145f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f73 expref: 28 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207824:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f73 expref: 27 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919553.207831:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919553.207833:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919553.207836:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030800, rc 0) 00000100:00100000:0.0:1790919553.207936:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12586:x1877914958272128:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 13092us (13427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919553.207944:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00010000:00010000:0.0:1790919553.441542:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790919554.017829:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1790919554.017846:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1790919554.017851:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:2.0:1790919554.027291:0:14287:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919554.027332:0:14287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919554.027390:0:14287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790919554.027399:0:14287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790919554.140350:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919554.140357:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919554.140394:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790919554.140403:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790919554.140519:0:13302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978233600:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919554.140609:0:13302:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece300 going to sleep for 11 seconds 00000100:00100000:0.0:1790919554.147367:0:13302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13302:1877914978233600:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919554.151498:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919554.152599:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958272640 00000100:00100000:3.0:1790919554.152611:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958272640 00000100:00100000:3.0:1790919554.152722:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:3.0:1790919554.152733:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12599:x1877914958272640:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919554.152770:0:7785:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919554.152876:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12599:x1877914958272640:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 144us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919554.152884:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:3.0:1790919554.159412:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919554.159482:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958272896 00000100:00100000:0.0:1790919554.159492:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958272896 00000100:00100000:0.0:1790919554.159543:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:0.0:1790919554.159553:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+27:12599:x1877914958272896:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919554.159575:0:13325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919554.159595:0:13325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15914612 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f7a expref: -99 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919554.159690:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914619 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919554.159718:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919554.159730:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919554.159742:0:13325:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790919554.159865:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014e00/0x951c50ad15914612 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f7a expref: 30 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919554.159884:0:13325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f7a expref: 29 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919554.159893:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919554.159895:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919554.159899:0:13325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015600, rc 0) 00000100:00100000:0.0:1790919554.159964:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12599:x1877914958272896:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 412us (561us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1790919554.159980:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:1.0:1790919554.168880:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919554.169365:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919554.169722:0:6432:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958273280 00000100:00100000:2.0:1790919554.169732:0:6432:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958273280 00000100:00100000:2.0:1790919554.169798:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919554.169809:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:2411:x1877914958273280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919554.169824:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919554.169847:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914619 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f7a expref: 29 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919554.169864:0:6432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:2.0:1790919554.169869:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919554.169921:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:2411:x1877914958273280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 114us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919554.169936:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1790919554.176095:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958273152 00000100:00100000:3.0:1790919554.176108:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958273152 00000100:00100000:3.0:1790919554.177412:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1790919554.177425:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+28:12599:x1877914958273152:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790919554.177513:0:10757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.177530:0:10757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.177541:0:10757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179343:0:10757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179358:0:10757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179365:0:10757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179372:0:10757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919554.179377:0:10757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179385:0:10757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179400:0:10757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:3.0:1790919554.179403:0:10757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919554.179408:0:10757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919554.179414:0:10757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15914627 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919554.179658:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919554.179663:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919554.180688:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790919554.181935:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790919554.182077:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12599:x1877914958273152:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 4650us (13201us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1790919554.182090:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1790919554.189089:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919554.189124:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958273536 00000100:00100000:3.0:1790919554.189133:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958273536 00000100:00100000:3.0:1790919554.189180:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1790919554.189190:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+29:12599:x1877914958273536:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790919554.189415:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:12599:x1877914958273536:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 226us (335us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1790919554.189424:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00010000:00010000:1.0:1790919554.460449:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919554.972419:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919554.972635:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978233856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919554.972746:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919554.972887:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978233856 00000100:00100000:2.0:1790919554.972895:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978233856 00000100:00100000:2.0:1790919554.974439:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790919554.974450:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978233856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919554.974494:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919554.974575:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978233856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919554.974582:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790919554.974660:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978233856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919554.975942:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978233728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919554.980022:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919554.980361:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978233728 00000100:00100000:0.0:1790919554.980370:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978233728 00000100:00100000:0.0:1790919554.980428:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790919554.980437:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978233728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919554.980477:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919554.980537:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978233728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919554.980545:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790919554.980699:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978233728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919555.020591:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020636:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020667:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020699:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020720:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020737:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020781:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919555.020810:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274176 00000100:00100000:1.0:1790919555.020821:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274176 00000100:00100000:1.0:1790919555.020877:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274048 00000100:00100000:1.0:1790919555.020880:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274048 00000100:00100000:1.0:1790919555.020903:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1790919555.020912:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958274176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919555.020985:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958274176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919555.020992:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1790919555.021008:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:1.0:1790919555.021015:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2411:x1877914958274048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919555.021040:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2411:x1877914958274048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919555.021046:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00080000:1.0:1790919555.021091:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919555.021095:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919555.021108:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958273792 00000100:00100000:1.0:1790919555.021112:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958273792 00000100:00100000:1.0:1790919555.021141:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958273920 00000100:00100000:1.0:1790919555.021144:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958273920 00000100:00100000:1.0:1790919555.021158:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274432 00000100:00100000:1.0:1790919555.021161:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274432 00000100:00100000:1.0:1790919555.021173:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274304 00000100:00100000:1.0:1790919555.021175:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274304 00000100:00100000:1.0:1790919555.021189:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:1.0:1790919555.021195:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:2411:x1877914958273792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919555.021226:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:2411:x1877914958273792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919555.021239:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:1.0:1790919555.021253:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:2.0:1790919555.021406:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958273664 00000100:00100000:2.0:1790919555.021411:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958273664 00000100:00100000:2.0:1790919555.021439:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 381 00000100:00100000:2.0:1790919555.021447:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958273664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919555.021476:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2412:x1877914958273664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919555.021483:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 381 00000100:00100000:1.0:1790919555.021601:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958273920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919555.021630:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2412:x1877914958273920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919555.023656:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:2.0:1790919555.023821:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:2.0:1790919555.023843:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958274304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919555.023874:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958274432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919555.023918:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2411:x1877914958274304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 86us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919555.023920:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2412:x1877914958274432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 249us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919555.023935:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:0.0:1790919555.023943:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00080000:0.0:1790919555.023994:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919555.023999:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919555.029443:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:0.0:1790919555.484216:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919555.484236:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978233984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919555.484343:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919555.484388:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978233984 00000100:00100000:0.0:1790919555.484394:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978233984 00010000:00010000:2.0:1790919555.484636:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919555.485616:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790919555.485629:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978233984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919555.485675:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919555.485749:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978233984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919555.485757:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1790919555.485782:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919555.485823:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978233984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919555.490335:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978234112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919555.490412:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919555.490507:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234112 00000100:00100000:0.0:1790919555.490515:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234112 00000100:00100000:0.0:1790919555.490568:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790919555.490577:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978234112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919555.490598:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790919555.490691:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919555.493457:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978234112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2875us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919555.493470:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790919555.494221:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978234112:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790919555.863140:0:14338:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919555.863151:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919555.863198:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790919555.863212:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790919556.006596:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919556.006736:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274688 00000100:00100000:1.0:1790919556.006747:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274688 00000100:00100000:1.0:1790919556.006809:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:1.0:1790919556.006819:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39891a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+30:12619:x1877914958274688:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919556.006840:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919556.006887:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad1591462e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f81 expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919556.006989:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15914635 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919556.007001:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15914635 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919556.007015:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15914635 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919556.007025:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790919556.007178:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad1591462e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f81 expref: 33 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919556.007208:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15914635 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f81 expref: 32 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919556.007217:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919556.007219:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790919556.007223:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d800, rc 0) 00000100:00100000:1.0:1790919556.007296:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39891a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:12619:x1877914958274688:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 467us (700us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1790919556.007303:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1790919556.011725:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919556.011925:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274816 00000100:00100000:0.0:1790919556.011935:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274816 00000100:00100000:0.0:1790919556.011985:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:0.0:1790919556.011994:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:12619:x1877914958274816:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1790919556.012085:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012102:0:13325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012113:0:13325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012138:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012151:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012159:0:13325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012164:0:13325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919556.012169:0:13325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012177:0:13325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012189:0:13325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:0.0:1790919556.012192:0:13325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790919556.012196:0:13325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919556.012202:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6014a00/0x951c50ad15914643 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919556.012266:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+32:12619:x1877914958274816:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 273us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919556.012273:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:1.0:1790919556.084721:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919556.084884:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958274944 00000100:00100000:2.0:1790919556.084895:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958274944 00000100:00100000:2.0:1790919556.084952:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:2.0:1790919556.084962:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958274944:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1790919556.084981:0:8082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919556.085001:0:8082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004386a1b8/0x951c50ad1591464a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f88 expref: -99 pid: 8082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919556.085039:0:8082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6abf4380, atime: 0x6abf4380, ctime: 0x6abf4380, blocks: 0xb 00010000:00010000:2.0:1790919556.085097:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1790919556.085102:0:8082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919556.085112:0:8082:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004386a1b8/0x951c50ad1591464a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f88 expref: 8 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919556.085132:0:8082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004386a1b8/0x951c50ad1591464a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f88 expref: 8 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919556.085144:0:8082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef200, rc 0) 00000100:00100000:2.0:1790919556.085205:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2413:x1877914958274944:12345-192.168.203.11@tcp:101:cat.0 Request processed in 244us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919556.085212:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1790919556.088649:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919556.088748:0:8090:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275072 00000100:00100000:3.0:1790919556.088758:0:8090:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275072 00002000:00100000:3.0:1790919556.088818:0:8090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff95f284c0a300 x1877914958275072/t0(0) o3->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:677/0 lens 488/0 e 0 to 0 dl 1790919567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919556.088829:0:8090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f284c0a300 with x1877914958275072 ext(0->4095) 00002000:00010000:3.0:1790919556.088834:0:8090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f284c0a300 00000100:00100000:3.0:1790919556.088868:0:8090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919556.088878:0:8090:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958275072:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:3.0:1790919556.089537:0:8090:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+8:2414:x1877914958275072:12345-192.168.203.11@tcp:3:cat.0 Request processed in 658us (894us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790919556.089546:0:8090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00002000:00100000:3.0:1790919556.089553:0:8090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff95f284c0a300 x1877914958275072/t0(0) o3->fd078e75-25ee-44fe-89dc-39e9cfa5e4b5@192.168.203.11@tcp:677/0 lens 488/4536 e 0 to 0 dl 1790919567 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790919556.089562:0:8090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95f284c0a300 with x1877914958275072 ext(0->4095) 00002000:00010000:3.0:1790919556.089566:0:8090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95f284c0a300 00010000:00010000:0.0:1790919556.510598:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919557.023169:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978234240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919557.023244:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919557.023265:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234240 00000100:00100000:0.0:1790919557.023273:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234240 00000100:00100000:0.0:1790919557.023337:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790919557.023347:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978234240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919557.023396:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919557.023452:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978234240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919557.023459:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790919557.023515:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978234240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919557.023635:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978234624:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023668:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.023703:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978235136:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023728:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.023744:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978235648:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023766:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.023783:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790919557.023788:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978234752:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023810:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.023828:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978235264:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023852:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.023879:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978235776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023910:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.023935:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234624 00000100:00100000:2.0:1790919557.023936:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978234496:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.023938:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234624 00000100:00100000:3.0:1790919557.023965:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234752 00000100:00100000:3.0:1790919557.023968:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234752 00000100:00100000:3.0:1790919557.023981:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790919557.023986:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978234624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.024633:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978234624:12345-0@lo:400:kworker.0 Request processed in 644us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.024641:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790919557.024659:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790919557.024666:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978234752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.024708:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978234752:12345-0@lo:400:kworker.0 Request processed in 43us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.024714:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790919557.024733:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235136 00000100:00100000:3.0:1790919557.024737:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235136 00000100:00100000:3.0:1790919557.024761:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235648 00000100:00100000:3.0:1790919557.024764:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235648 00000100:00100000:3.0:1790919557.024783:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790919557.024789:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978235136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.024819:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978235136:12345-0@lo:400:kworker.0 Request processed in 31us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.024826:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790919557.024836:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790919557.024842:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978235648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.024879:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978235648:12345-0@lo:400:kworker.0 Request processed in 37us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.024885:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790919557.024906:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235264 00000100:00100000:3.0:1790919557.024909:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235264 00000100:00100000:3.0:1790919557.024930:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235776 00000100:00100000:3.0:1790919557.024932:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235776 00000100:00100000:3.0:1790919557.024948:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790919557.024954:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978235264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.024983:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978235264:12345-0@lo:400:kworker.0 Request processed in 29us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.024989:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790919557.024999:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790919557.025005:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bbfe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978235776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.025043:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bbfe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978235776:12345-0@lo:400:kworker.0 Request processed in 39us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.025049:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790919557.025242:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978234752:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.025253:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978235264:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.025262:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1790919557.025267:0:3460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1790919557.025294:0:3460:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f285aaaa00, transno 4294967311 00000100:00100000:3.0:1790919557.025305:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978235776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.025316:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978234624:0@lo:400:kworker.0 00010000:00080000:3.0:1790919557.025329:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2871ab100 x1877914978235136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919557.025347:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978235136:0@lo:400:kworker.0 00010000:00080000:3.0:1790919557.025359:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2871a8380 x1877914978235648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919557.025366:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978235648:0@lo:400:kworker.0 00000100:00100000:0.0:1790919557.025971:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978234368:0@lo:400:kworker.0 00000100:00100000:0.0:1790919557.026032:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919557.026089:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978234880:0@lo:400:kworker.0 00000100:00100000:0.0:1790919557.026116:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919557.026134:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978235392:0@lo:400:kworker.0 00000100:00100000:0.0:1790919557.026158:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919557.026188:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234880 00000100:00100000:0.0:1790919557.026193:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234880 00000100:00100000:0.0:1790919557.026227:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790919557.026234:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978234880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919557.026286:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978234880:12345-0@lo:400:kworker.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919557.026293:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790919557.026326:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978234880:0@lo:400:kworker.0 00000100:00080000:1.0:1790919557.028047:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919557.028084:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919557.028087:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919557.028111:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235392 00000100:00100000:1.0:1790919557.028119:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235392 00000100:00100000:1.0:1790919557.028169:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790919557.028177:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978235392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919557.028248:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3458:x1877914978235392:12345-0@lo:400:kworker.0 Request processed in 72us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919557.028255:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1790919557.028287:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919557.028302:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978235904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919557.028339:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919557.028383:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978235392:0@lo:400:kworker.0 00000100:00100000:1.0:1790919557.028413:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235904 00000100:00100000:1.0:1790919557.028431:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235904 00000100:00100000:1.0:1790919557.028460:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790919557.028466:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978235904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919557.028482:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919557.028518:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978235904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919557.028525:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790919557.028556:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978235904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919557.030523:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234368 00000100:00100000:3.0:1790919557.030535:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234368 00000100:00100000:3.0:1790919557.030579:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1790919557.030588:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978234368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.030662:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978234368:12345-0@lo:400:kworker.0 Request processed in 75us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919557.030669:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1790919557.031498:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978234368:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.033250:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.033316:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978235008:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.033352:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919557.033376:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978235520:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.033397:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919557.033610:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978234496 00000100:00100000:0.0:1790919557.033621:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978234496 00000100:00100000:0.0:1790919557.033679:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235008 00000100:00100000:0.0:1790919557.033684:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235008 00000100:00100000:0.0:1790919557.033706:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978235520 00000100:00100000:0.0:1790919557.033717:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978235520 00000100:00100000:0.0:1790919557.033740:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1790919557.033747:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978234496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919557.033799:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790919557.033808:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978235008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919557.033863:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978235008:12345-0@lo:400:kworker.0 Request processed in 56us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919557.033869:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790919557.033884:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790919557.033889:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978235520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919557.033912:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978235520:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919557.033913:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978234496:12345-0@lo:400:kworker.0 Request processed in 167us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919557.033918:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1790919557.033921:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1790919557.033941:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919557.035432:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978234496:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.035451:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978235008:0@lo:400:kworker.0 00000100:00100000:3.0:1790919557.035461:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978235520:0@lo:400:kworker.0 00010000:00010000:1.0:1790919557.532422:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919558.082152:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1790919558.082171:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f386592600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1790919558.082176:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3b5f0b700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f386592000 00000020:00080000:0.0:1790919558.082180:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3b5f0b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f285a9dc00 00000001:00080000:0.0:1790919558.082199:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1790919558.082209:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1790919558.082406:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919558.082418:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919558.082438:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919558.082444:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380031a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919558.082449:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919558.082457:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919558.082475:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff95f3904a5a00) 00010000:00010000:3.0:1790919558.082478:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919558.082483:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919558.082490:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad159145c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6447 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790919558.083258:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790919558.083466:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1790919558.556216:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790919558.647444:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1790919558.647458:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:0.0:1790919559.584335:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919560.055249:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919560.055382:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275200 00000100:00100000:1.0:1790919560.055392:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275200 00000100:00080000:2.0:1790919560.055523:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919560.055568:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:1.0:1790919560.055581:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12263:x1877914958275200:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790919560.055711:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12263:x1877914958275200:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 133us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919560.055719:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:1.0:1790919560.069138:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919560.069292:0:10757:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275328 00000100:00100000:2.0:1790919560.069301:0:10757:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275328 00000100:00100000:2.0:1790919560.069383:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:2.0:1790919560.069393:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:12263:x1877914958275328:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1790919560.069551:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919560.069940:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:12263:x1877914958275328:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 546us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919560.069949:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:2.0:1790919560.083150:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919560.083233:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275584 00000100:00100000:3.0:1790919560.083243:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275584 00000100:00100000:3.0:1790919560.083308:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1790919560.083317:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:12263:x1877914958275584:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790919560.083590:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:12263:x1877914958275584:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 271us (446us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1790919560.083617:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1790919560.092579:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919560.092602:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978236032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919560.092751:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919560.092869:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236032 00000100:00100000:2.0:1790919560.092877:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236032 00000100:00100000:2.0:1790919560.092931:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790919560.092940:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978236032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919560.092981:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1790919560.093035:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978236032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919560.093042:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790919560.093110:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978236032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919560.093230:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919560.093243:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978236160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919560.093284:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919560.093456:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236160 00000100:00100000:1.0:1790919560.093461:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236160 00000100:00100000:1.0:1790919560.093496:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790919560.093503:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978236160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919560.093525:0:6450:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919560.093572:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978236160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919560.093578:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790919560.093650:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978236160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919560.137581:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919560.137628:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919560.137658:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919560.137693:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919560.137722:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919560.137752:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275968 00000100:00100000:0.0:1790919560.137761:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275968 00000100:00100000:0.0:1790919560.137816:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275840 00000100:00100000:0.0:1790919560.137820:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275840 00000100:00100000:0.0:1790919560.137846:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1790919560.137857:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958275968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919560.137927:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2413:x1877914958275968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919560.137935:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1790919560.137954:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1790919560.137975:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958275840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919560.138003:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2413:x1877914958275840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919560.138010:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1790919560.138032:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276224 00000100:00100000:0.0:1790919560.138036:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276224 00000100:00100000:0.0:1790919560.138105:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276096 00000100:00100000:0.0:1790919560.138109:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276096 00000100:00100000:0.0:1790919560.138129:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:0.0:1790919560.138134:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958276224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919560.138162:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958276224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919560.138168:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:0.0:1790919560.138181:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:0.0:1790919560.138187:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958276096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919560.138211:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2413:x1877914958276096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919560.138217:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00080000:0.0:1790919560.138237:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919560.138240:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919560.138242:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919560.138244:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919560.138627:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958275712 00000100:00100000:2.0:1790919560.138633:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958275712 00000100:00100000:2.0:1790919560.138671:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 383 00000100:00100000:2.0:1790919560.138678:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958275712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919560.138723:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d4af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a8157f22-2e62-481b-a08b-6545627fb184+13:2413:x1877914958275712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919560.138738:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 383 00000040:00080000:3.0:1790919560.349271:0:13302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919560.349282:0:13302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919560.349555:0:13302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1790919560.349562:0:13302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790919560.604373:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919560.604768:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919560.604930:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919560.604950:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978236416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919560.605031:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919560.605141:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236416 00000100:00100000:3.0:1790919560.605150:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236416 00000100:00100000:3.0:1790919560.605206:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790919560.605216:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978236416:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790919560.605220:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790919560.605262:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919560.605320:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978236416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919560.605327:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790919560.606595:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1790919560.606605:0:3459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f2871a8000, transno 4294967323 00000004:00080000:0.0:1790919560.606618:0:3459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1790919560.606648:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978236416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919560.610263:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978236288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919560.610344:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919560.610488:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236288 00000100:00100000:2.0:1790919560.610498:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236288 00000100:00100000:2.0:1790919560.610562:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790919560.610572:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978236288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790919560.610596:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919560.610644:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978236288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919560.610651:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1790919560.611349:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919560.611444:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978236288:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1790919560.925006:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919561.628250:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919562.140303:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978236544:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140374:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140418:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978237056:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140447:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140479:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978237568:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140506:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140524:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978238080:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140546:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140569:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790919562.140583:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978236928:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140609:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140627:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978237440:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140649:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140665:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978237952:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140686:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140716:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978236672:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140738:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140755:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978237184:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140772:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140787:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978237696:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140807:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140825:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790919562.140831:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978236800:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140856:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140873:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978237312:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140894:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140911:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978237824:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.140940:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.140980:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236544 00000100:00100000:3.0:1790919562.140988:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236544 00000100:00100000:3.0:1790919562.141043:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1790919562.141068:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978236544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.141121:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3459:x1877914978236544:12345-0@lo:400:kworker.0 Request processed in 70us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.141138:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1790919562.141175:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237056 00000100:00100000:3.0:1790919562.141179:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237056 00000100:00100000:3.0:1790919562.141197:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236672 00000100:00100000:3.0:1790919562.141200:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236672 00000100:00100000:3.0:1790919562.141210:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237184 00000100:00100000:3.0:1790919562.141212:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237184 00000100:00100000:0.0:1790919562.142479:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237696 00000100:00100000:0.0:1790919562.142489:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237696 00000100:00100000:2.0:1790919562.146340:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237312 00000100:00100000:2.0:1790919562.146354:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237312 00000100:00100000:2.0:1790919562.146404:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237824 00000100:00100000:2.0:1790919562.146408:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237824 00000100:00100000:2.0:1790919562.146430:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1790919562.147640:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978238336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919562.147778:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919562.147924:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790919562.147938:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978236672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.148004:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919562.148015:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978238208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919562.148341:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919562.148377:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238336 00000100:00100000:3.0:1790919562.148384:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238336 00000100:00100000:3.0:1790919562.148413:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238208 00000100:00100000:3.0:1790919562.148416:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238208 00000100:00100000:3.0:1790919562.148432:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790919562.148439:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978238336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919562.148537:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919562.148579:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978238336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.148587:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790919562.148603:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790919562.148610:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978238208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919562.148621:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919562.148647:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978238208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.148735:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790919562.148783:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978238208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919562.148797:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978238336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919562.148938:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978236672:12345-0@lo:400:kworker.0 Request processed in 65us (7258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919562.148949:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790919562.148967:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790919562.148976:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978237312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149029:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978236672:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149075:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3459:1877914978236544:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149110:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790919562.149117:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978237824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149288:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978237824:12345-0@lo:400:kworker.0 Request processed in 171us (8347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.149295:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00080000:3.0:1790919562.149327:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845aad80 x1877914978237824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919562.149342:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978237824:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.149342:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978237312:12345-0@lo:400:kworker.0 Request processed in 366us (8444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919562.149354:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00080000:3.0:1790919562.149369:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845ab480 x1877914978237312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919562.149376:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790919562.149385:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978237312:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.149391:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978237696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149412:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1790919562.149423:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978237184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.149447:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978237696:12345-0@lo:400:kworker.0 Request processed in 59us (8635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919562.149455:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790919562.149483:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237568 00000100:00100000:0.0:1790919562.149489:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237568 00000100:00100000:0.0:1790919562.149508:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238080 00000100:00100000:0.0:1790919562.149510:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238080 00000100:00100000:3.0:1790919562.149520:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978237696:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.149523:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237440 00000100:00100000:3.0:1790919562.149567:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978237184:12345-0@lo:400:kworker.0 Request processed in 147us (8793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.149584:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1790919562.149611:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978237184:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149653:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236928 00000100:00100000:3.0:1790919562.149657:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236928 00000100:00100000:3.0:1790919562.149744:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978236800 00000100:00100000:3.0:1790919562.149748:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978236800 00000100:00100000:3.0:1790919562.149761:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790919562.149768:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978236928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.149925:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978236928:12345-0@lo:400:kworker.0 Request processed in 39us (9196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.149992:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790919562.150007:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790919562.150013:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978236800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.150071:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978236800:12345-0@lo:400:kworker.0 Request processed in 39us (9194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.150077:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790919562.150111:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978236800:0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.150138:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978236928:0@lo:400:kworker.0 00000100:00100000:2.0:1790919562.150302:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.150326:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237440 00000100:00100000:0.0:1790919562.150354:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978237952 00000100:00100000:0.0:1790919562.150359:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978237952 00000100:00100000:2.0:1790919562.150360:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978237056:12345-0@lo:400:kworker.0 Request processed in 3920us (9910us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919562.150371:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790919562.150380:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790919562.150390:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978237568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.150427:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978237056:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.150435:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978237568:12345-0@lo:400:kworker.0 Request processed in 47us (9926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919562.150444:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978237568:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.150444:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790919562.150463:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919562.150470:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978238080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.150503:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978238080:12345-0@lo:400:kworker.0 Request processed in 33us (9956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919562.150509:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919562.150526:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790919562.150532:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978238080:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.152908:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978237440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919562.153152:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978237440:0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.153152:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978237440:12345-0@lo:400:kworker.0 Request processed in 261us (12502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919562.153354:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790919562.153384:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790919562.153392:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978237952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919562.153444:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978237952:12345-0@lo:400:kworker.0 Request processed in 53us (12756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919562.153563:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1790919562.153604:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919562.153610:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919562.153614:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919562.153617:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919562.153630:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978237952:0@lo:400:kworker.0 00000001:02000400:0.0:1790919562.291468:0:14537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:39:21 (1790919561) 00010000:00010000:0.0:1790919562.655462:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919563.249844:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1790919563.249858:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1790919563.249935:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1790919563.249947:0:6478:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790919563.676317:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919564.700234:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919564.754216:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919564.754335:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276352 00000100:00100000:2.0:1790919564.754346:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276352 00000100:00100000:2.0:1790919564.754429:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1790919564.754440:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:13292:x1877914958276352:12345-192.168.203.11@tcp:101:lsof.0 00010000:00010000:2.0:1790919564.754476:0:6446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919564.754496:0:6446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38f8f expref: -99 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919564.754558:0:6446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efe00/0x951c50ad15914658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919564.754572:0:6446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efe00/0x951c50ad15914658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919564.754584:0:6446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efe00/0x951c50ad15914658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919564.754618:0:6446:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919564.754622:0:6446:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919564.754660:0:6446:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efe00/0x951c50ad15914658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919564.754684:0:6446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860ef800/0x951c50ad15914651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f8f expref: 7 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919564.754701:0:6446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efe00/0x951c50ad15914658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f8f expref: 6 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919564.754719:0:6446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:2.0:1790919564.754722:0:6446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919564.754725:0:6446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860efe00, rc 0) 00000100:00100000:2.0:1790919564.754792:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:13292:x1877914958276352:12345-192.168.203.11@tcp:101:lsof.0 Request processed in 355us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919564.754800:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00080000:0.0:1790919564.755137:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919565.212631:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978238464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919565.212703:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919565.212961:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978238592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919565.212994:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919565.213084:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238464 00000100:00100000:0.0:1790919565.213092:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238464 00000100:00100000:2.0:1790919565.213132:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238592 00000100:00100000:2.0:1790919565.213137:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238592 00000100:00100000:0.0:1790919565.213161:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790919565.213172:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790919565.213175:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978238464:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919565.213183:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978238592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919565.213225:0:6451:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1790919565.213226:0:7568:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261909504 avail 2259812352 00000100:00100000:0.0:1790919565.213290:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978238464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919565.213297:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790919565.213390:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978238464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919565.214825:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978238592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1638us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919565.214836:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790919565.215482:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978238592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919565.256152:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919565.256462:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276480 00000100:00100000:0.0:1790919565.256472:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276480 00000100:00100000:0.0:1790919565.256529:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 385 00000100:00100000:0.0:1790919565.256539:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958276480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919565.256843:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a8157f22-2e62-481b-a08b-6545627fb184+13:2414:x1877914958276480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 305us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919565.256852:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 385 00000100:00100000:0.0:1790919565.261042:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919565.261197:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919565.261236:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919565.261259:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919565.261283:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919565.261284:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276608 00000100:00100000:2.0:1790919565.261294:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276608 00000100:00100000:0.0:1790919565.261319:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276992 00000100:00100000:0.0:1790919565.261337:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276992 00000100:00100000:2.0:1790919565.261350:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276736 00000100:00100000:2.0:1790919565.261354:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276736 00000100:00100000:0.0:1790919565.261377:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958276864 00000100:00100000:2.0:1790919565.261380:0:13325:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958277120 00000100:00100000:0.0:1790919565.261382:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958276864 00000100:00100000:2.0:1790919565.261385:0:13325:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958277120 00000100:00100000:2.0:1790919565.261426:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:0.0:1790919565.261426:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1790919565.261440:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2414:x1877914958276608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919565.261443:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958276992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919565.261746:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958276992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 307us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919565.261827:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:0.0:1790919565.261849:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1790919565.261857:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958276864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919565.262141:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 307 00000100:00100000:3.0:1790919565.262151:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958276736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919565.268193:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:2414:x1877914958276608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 6743us (7148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919565.268202:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2414:x1877914958276864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 6342us (6937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919565.268212:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:0.0:1790919565.268229:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:2.0:1790919565.268267:0:13325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:2.0:1790919565.268281:0:13325:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958277120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:0.0:1790919565.268316:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919565.268324:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919565.268327:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919565.268332:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919565.268339:0:13325:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2414:x1877914958277120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 62us (7053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919565.268347:0:13325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:3.0:1790919565.271109:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2414:x1877914958276736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 8947us (9900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919565.271124:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 307 00010000:00010000:0.0:1790919565.724426:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919565.724969:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978238720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919565.725032:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919565.725315:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919565.725323:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978238848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919565.725351:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919565.725381:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238720 00000100:00100000:0.0:1790919565.725387:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238720 00000100:00100000:0.0:1790919565.725431:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238848 00000100:00100000:0.0:1790919565.725433:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238848 00000100:00100000:0.0:1790919565.725446:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919565.725454:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978238720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919565.725485:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919565.725545:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978238720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919565.725552:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790919565.725570:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790919565.725575:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978238848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919565.725584:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919565.725602:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978238848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919565.725607:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1790919565.725781:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919565.725823:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978238848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919565.725849:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978238720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919566.235515:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919566.235639:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958277376 00000100:00100000:3.0:1790919566.235649:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958277376 00000100:00100000:3.0:1790919566.235705:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1790919566.235715:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+18:13293:x1877914958277376:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:3.0:1790919566.236006:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:13293:x1877914958277376:12345-192.168.203.11@tcp:35:umount.0 Request processed in 292us (499us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1790919566.236014:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1790919566.244954:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919566.245094:0:6449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958277632 00000100:00100000:3.0:1790919566.245105:0:6449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958277632 00000100:00100000:3.0:1790919566.245445:0:6449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1790919566.245458:0:6449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+19:13293:x1877914958277632:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:3.0:1790919566.246016:0:6449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:13293:x1877914958277632:12345-192.168.203.11@tcp:35:umount.0 Request processed in 559us (1070us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1790919566.246026:0:6449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1790919566.250217:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919566.250386:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958277888 00000100:00100000:0.0:1790919566.250396:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958277888 00000100:00100000:0.0:1790919566.250453:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1790919566.250464:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f390323c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+20:13293:x1877914958277888:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:0.0:1790919566.250714:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f390323c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:13293:x1877914958277888:12345-192.168.203.11@tcp:35:umount.0 Request processed in 252us (513us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1790919566.250721:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790919566.254537:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919566.258075:0:6448:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958278144 00000100:00100000:0.0:1790919566.258090:0:6448:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958278144 00000100:00100000:0.0:1790919566.258164:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790919566.258184:0:6448:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:13293:x1877914958278144:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:0.0:1790919566.258547:0:6448:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:13293:x1877914958278144:12345-192.168.203.11@tcp:35:umount.0 Request processed in 372us (4016us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1790919566.258554:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:1.0:1790919566.263519:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919566.263603:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919566.263738:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919566.267023:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958278272 00000100:00100000:3.0:1790919566.267037:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958278272 00000100:00100000:3.0:1790919566.267115:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958278400 00000100:00100000:3.0:1790919566.267119:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958278400 00000100:00100000:3.0:1790919566.267145:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790919566.267153:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+14:2411:x1877914958278272:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790919566.267352:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919566.267364:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8157f22-2e62-481b-a08b-6545627fb184+14:2411:x1877914958278400:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919566.267390:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919566.267408:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014600/0x951c50ad159135d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ad4 expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919566.267425:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919566.267484:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8157f22-2e62-481b-a08b-6545627fb184+13:2411:x1877914958278400:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 123us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919566.267492:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00010000:00010000:3.0:1790919566.267652:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919566.267664:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204ba00/0x951c50ad15913691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b13 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919566.267675:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919566.267709:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+11:2411:x1877914958278272:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 557us (4200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919566.267716:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790919566.268089:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919566.268343:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958278528 00000100:00100000:2.0:1790919566.268349:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958278528 00000100:00100000:2.0:1790919566.268384:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919566.268392:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a8157f22-2e62-481b-a08b-6545627fb184+11:2414:x1877914958278528:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919566.268400:0:13233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919566.268411:0:13233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1d400/0x951c50ad159138e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bec expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919566.268423:0:13233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919566.268448:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a8157f22-2e62-481b-a08b-6545627fb184+10:2414:x1877914958278528:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 58us (4711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919566.268455:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1790919566.269626:0:8084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958278656 00000100:00100000:1.0:1790919566.269635:0:8084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958278656 00000100:00100000:1.0:1790919566.269681:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:1.0:1790919566.269689:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2410:x1877914958278656:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:1.0:1790919566.269715:0:8084:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159139af 00000100:00080000:1.0:1790919566.269724:0:8084:0:(import.c:65:import_set_state_nolock()) ffff95f3a690e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919566.269759:0:8084:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1790919566.270027:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919566.270467:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+2:2410:x1877914958278656:12345-192.168.203.11@tcp:9:umount.0 Request processed in 776us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919566.270476:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:1.0:1790919566.279238:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919566.279375:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958279040 00000100:00100000:2.0:1790919566.279384:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958279040 00000100:00100000:2.0:1790919566.279445:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:2.0:1790919566.279455:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+7:2410:x1877914958279040:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:2.0:1790919566.279486:0:8083:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913c17 00000020:00010000:2.0:1790919566.279494:0:8083:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f3b4713000: total 0 00000100:00080000:2.0:1790919566.279513:0:8083:0:(import.c:65:import_set_state_nolock()) ffff95f398dcc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790919566.279559:0:8083:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790919566.279805:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2410:x1877914958279040:12345-192.168.203.11@tcp:9:umount.0 Request processed in 350us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919566.279812:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000020:00010000:1.0:1790919566.280374:0:7708:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f3b4713000: total 0 00010000:00010000:1.0:1790919566.280406:0:7708:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f3b4713000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790919566.280457:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb374c0/0x951c50ad15913fb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dc1 expref: 4 pid: 8248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.280495:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004386a1b8/0x951c50ad1591464a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f88 expref: 3 pid: 8082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.280525:0:7708:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f3b4713000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790919566.280537:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919566.280539:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919566.280541:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919566.288257:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919566.288439:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280064 00000100:00100000:0.0:1790919566.288463:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280064 00000100:00100000:0.0:1790919566.288523:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:0.0:1790919566.288533:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+22:2410:x1877914958280064:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:0.0:1790919566.288569:0:6445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135e2 00000020:00010000:0.0:1790919566.288585:0:6445:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f2862eb800: total 0 00000100:00080000:0.0:1790919566.288589:0:6445:0:(import.c:65:import_set_state_nolock()) ffff95f398dc9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919566.288627:0:6445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1790919566.289485:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+21:2410:x1877914958280064:12345-192.168.203.11@tcp:39:umount.0 Request processed in 948us (1242us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1790919566.289495:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000020:00010000:1.0:1790919566.290130:0:6433:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f2862eb800: total 0 00010000:00010000:1.0:1790919566.290173:0:6433:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f2862eb800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790919566.290224:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919566.290229:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790919566.290238:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15913985 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c16 expref: 20 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290267:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919566.290270:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790919566.290275:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d800/0x951c50ad15914635 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f81 expref: 19 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290290:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919566.290292:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919566.290296:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015000/0x951c50ad15913e94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38d74 expref: 18 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290309:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919566.290312:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919566.290316:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914309 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38eaf expref: 17 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290327:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff95f392142300) 00010000:00010000:1.0:1790919566.290342:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790919566.290347:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad1591402a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ddd expref: 16 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290367:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:1.0:1790919566.290370:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919566.290373:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad1591392a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38c01 expref: 15 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290387:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919566.290389:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919566.290392:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015800/0x951c50ad15913f74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dac expref: 14 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290403:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919566.290405:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790919566.290409:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad15913f9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dba expref: 13 pid: 7785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290424:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919566.290426:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919566.290430:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c600/0x951c50ad1591452b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f3b expref: 12 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290441:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:1.0:1790919566.290444:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919566.290447:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad1591400e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38dd6 expref: 11 pid: 6447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290472:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff95f3930c1100) 00010000:00010000:1.0:1790919566.290475:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790919566.290479:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15913c72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38ce8 expref: 10 pid: 13325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290494:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919566.290497:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919566.290500:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad1591390e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38bfa expref: 9 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290514:0:6433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff95f382b81a00) 00010000:00010000:1.0:1790919566.290516:0:6433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919566.290519:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad1591460b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f73 expref: 8 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919566.290531:0:6433:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f2862eb800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790919566.290544:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919566.290546:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919566.290548:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919566.298557:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919566.298628:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280192 00000100:00100000:0.0:1790919566.298638:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280192 00000100:00100000:0.0:1790919566.298688:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:0.0:1790919566.298697:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+5:2410:x1877914958280192:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:0.0:1790919566.298729:0:7785:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135e9 00000100:00080000:0.0:1790919566.298745:0:7785:0:(import.c:65:import_set_state_nolock()) ffff95f3a6bae800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919566.298775:0:7785:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1790919566.299318:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919566.299474:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fd078e75-25ee-44fe-89dc-39e9cfa5e4b5+3:2410:x1877914958280192:12345-192.168.203.11@tcp:39:umount.0 Request processed in 776us (922us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790919566.299483:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00010000:00010000:3.0:1790919566.749157:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919567.260271:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978238976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919567.260316:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978239488:0@lo:400:kworker.0 00000100:00100000:2.0:1790919567.260337:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.260345:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919567.260389:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978239104:0@lo:400:kworker.0 00000100:00100000:1.0:1790919567.260432:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978238976 00000100:00100000:1.0:1790919567.260440:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978238976 00000100:00100000:1.0:1790919567.260487:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790919567.260496:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978238976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919567.260526:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919567.261140:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239488 00000100:00100000:0.0:1790919567.261146:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239488 00000100:00100000:0.0:1790919567.261174:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790919567.261180:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978239488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261271:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978239232:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261306:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261325:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978239744:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261343:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261363:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978240256:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261397:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261418:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978240768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919567.261442:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261463:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790919567.261468:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978239616:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261487:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261502:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978240128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261521:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261537:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978240640:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261553:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261576:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978240000:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261595:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261745:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978240512:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261767:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261784:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790919567.261789:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978239360:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261808:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261827:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978239872:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261845:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261860:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978240384:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.261878:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919567.261902:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240128 00000100:00100000:3.0:1790919567.261907:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240128 00000100:00100000:3.0:1790919567.261929:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240640 00000100:00100000:3.0:1790919567.261932:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240640 00000100:00100000:3.0:1790919567.261953:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240000 00000100:00100000:3.0:1790919567.261956:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240000 00000100:00100000:3.0:1790919567.261965:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240512 00000100:00100000:3.0:1790919567.262014:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240512 00000100:00100000:3.0:1790919567.262029:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790919567.262035:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978240128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262092:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978240128:12345-0@lo:400:kworker.0 Request processed in 56us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.262099:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790919567.262114:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790919567.262120:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978240640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262143:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978240640:12345-0@lo:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.262148:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790919567.262157:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790919567.262162:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978240000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262188:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978240000:12345-0@lo:400:kworker.0 Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.262193:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790919567.262216:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790919567.262222:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3461:x1877914978240512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262247:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3461:x1877914978240512:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.262252:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790919567.262283:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978240128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262292:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978240640:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262326:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978240000:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262335:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978240512:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262356:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239232 00000100:00100000:3.0:1790919567.262359:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239232 00000100:00100000:3.0:1790919567.262375:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239744 00000100:00100000:3.0:1790919567.262377:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239744 00000100:00100000:3.0:1790919567.262388:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240256 00000100:00100000:3.0:1790919567.262390:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240256 00000100:00100000:3.0:1790919567.262400:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239616 00000100:00100000:3.0:1790919567.262402:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239616 00000100:00100000:3.0:1790919567.262409:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239872 00000100:00100000:3.0:1790919567.262411:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239872 00000100:00100000:3.0:1790919567.262420:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240384 00000100:00100000:3.0:1790919567.262422:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240384 00000100:00100000:3.0:1790919567.262432:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1790919567.262437:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978239232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262470:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978239232:12345-0@lo:400:kworker.0 Request processed in 32us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.262476:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1790919567.262495:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978239232:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262509:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1790919567.262515:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978239744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262543:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978239744:12345-0@lo:400:kworker.0 Request processed in 28us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.262548:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1790919567.262567:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978239744:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.262591:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1790919567.262596:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978240256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.263853:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978240256:12345-0@lo:400:kworker.0 Request processed in 1254us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.263862:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1790919567.263898:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978240256:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.263921:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1790919567.263929:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978239616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.263960:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978239616:12345-0@lo:400:kworker.0 Request processed in 32us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.263965:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1790919567.263997:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978239616:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264013:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1790919567.264020:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978239872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264062:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978239872:12345-0@lo:400:kworker.0 Request processed in 31us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.264069:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00080000:3.0:1790919567.264093:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c0ca80 x1877914978239872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919567.264104:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978239872:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264120:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1790919567.264126:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978240384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264156:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978240384:12345-0@lo:400:kworker.0 Request processed in 31us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.264172:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00080000:3.0:1790919567.264193:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2871ab800 x1877914978240384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919567.264213:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978240384:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264283:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239360 00000100:00100000:3.0:1790919567.264289:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239360 00000100:00100000:3.0:1790919567.264317:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790919567.264324:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978239360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264361:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978239360:12345-0@lo:400:kworker.0 Request processed in 37us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.264367:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790919567.264393:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978239360:0@lo:400:kworker.0 00000100:00100000:3.0:1790919567.264469:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240768 00000100:00100000:3.0:1790919567.264473:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240768 00000100:00100000:3.0:1790919567.264491:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790919567.264497:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3bc01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978240768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919567.264512:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919567.264545:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3bc01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978240768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919567.264551:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790919567.264579:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978240768:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790919567.264632:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919567.264637:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919567.264639:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919567.264642:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919567.265249:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919567.265292:0:6438:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978239104 00000100:00100000:2.0:1790919567.265298:0:6438:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978239104 00000100:00100000:2.0:1790919567.265324:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1790919567.265331:0:6438:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978239104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919567.265365:0:6438:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978239104:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919567.265371:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1790919567.265417:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978239104:0@lo:400:kworker.0 00000100:00100000:1.0:1790919567.270666:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978238976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10163us (10320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919567.270691:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978239488:12345-0@lo:400:kworker.0 Request processed in 9508us (10341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919567.270693:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790919567.270705:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790919567.270781:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978239488:0@lo:400:kworker.0 00000100:00100000:0.0:1790919567.270849:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978238976:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1790919567.319445:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000001:00080000:0.0:1790919567.319470:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1790919567.319475:0:7248:0:(genops.c:885:class_export_put()) final put ffff95f3a6bad800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:3.0:1790919567.319548:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a6bad800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-MDT0001 00000020:00000080:3.0:1790919567.320146:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3a6bae800 for lustre-MDT0001 00010000:00010000:1.0:1790919567.774362:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919568.226013:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919568.226099:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919568.226141:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919568.226243:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280320 00000100:00100000:1.0:1790919568.226253:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280320 00000100:00100000:0.0:1790919568.226278:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280448 00000100:00100000:0.0:1790919568.226285:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280448 00000100:00100000:1.0:1790919568.226316:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280576 00000100:00100000:1.0:1790919568.226322:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280576 00000100:00100000:0.0:1790919568.226326:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1790919568.226338:0:6430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+12:2413:x1877914958280320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919568.226353:0:6430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790919568.226357:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1790919568.226368:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8157f22-2e62-481b-a08b-6545627fb184+12:2413:x1877914958280448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919568.226376:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c400/0x951c50ad159136e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b28 expref: 12 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919568.226379:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919568.226394:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6486600/0x951c50ad159136ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b59 expref: 11 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919568.226397:0:6430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919568.226409:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919568.226450:0:6430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a8157f22-2e62-481b-a08b-6545627fb184+10:2413:x1877914958280320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 115us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919568.226458:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790919568.226480:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790919568.226623:0:6432:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8157f22-2e62-481b-a08b-6545627fb184+9:2414:x1877914958280576:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919568.226634:0:6432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919568.226645:0:6432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1dc00/0x951c50ad159138dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38be5 expref: 9 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919568.226655:0:6432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919568.228904:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a8157f22-2e62-481b-a08b-6545627fb184+8:2413:x1877914958280448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2527us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919568.229403:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790919568.229692:0:6432:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a8157f22-2e62-481b-a08b-6545627fb184+7:2414:x1877914958280576:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3201us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919568.229701:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790919568.230949:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919568.231168:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280832 00000100:00100000:0.0:1790919568.231178:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280832 00000100:00100000:0.0:1790919568.231258:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:0.0:1790919568.231268:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+6:2410:x1877914958280832:12345-192.168.203.11@tcp:39:umount.0 00000100:00080000:1.0:1790919568.231278:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1790919568.231305:0:6447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159136fa 00000020:00010000:0.0:1790919568.231314:0:6447:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f3a6ba9000: total 0 00000100:00080000:0.0:1790919568.231320:0:6447:0:(import.c:65:import_set_state_nolock()) ffff95f3a6bac800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919568.231349:0:6447:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:1.0:1790919568.231403:0:6434:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f3a6ba9000: total 0 00010000:00010000:1.0:1790919568.231407:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919568.231458:0:6434:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f3a6ba9000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790919568.231491:0:6434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f382b81800) 00010000:00010000:1.0:1790919568.231495:0:6434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919568.231502:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f2860efe00/0x951c50ad15914658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38f8f expref: 6 pid: 6446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919568.231526:0:6434:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f3a6ba9000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1790919568.231534:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919568.231535:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919568.231548:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919568.231756:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0eadf68-44c6-442a-b15d-9a125194f9a5+3:2410:x1877914958280832:12345-192.168.203.11@tcp:39:umount.0 Request processed in 488us (811us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1790919568.231770:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:2.0:1790919568.248790:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919568.248902:0:6446:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958280960 00000100:00100000:3.0:1790919568.248913:0:6446:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958280960 00000100:00100000:3.0:1790919568.249400:0:6446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:3.0:1790919568.249414:0:6446:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+5:2410:x1877914958280960:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:3.0:1790919568.249457:0:6446:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913701 00000100:00080000:3.0:1790919568.249467:0:6446:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919568.249571:0:6446:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1790919568.249726:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919568.250754:0:6446:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0eadf68-44c6-442a-b15d-9a125194f9a5+3:2410:x1877914958280960:12345-192.168.203.11@tcp:39:umount.0 Request processed in 1336us (1968us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790919568.250767:0:6446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00080000:1.0:1790919568.250886:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919568.294486:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919568.295040:0:6439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281216 00000100:00100000:3.0:1790919568.295080:0:6439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281216 00000100:00100000:3.0:1790919568.295142:0:6439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 387 00000100:00100000:3.0:1790919568.295155:0:6439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+7:2410:x1877914958281216:12345-192.168.203.11@tcp:251:umount.0 00000020:00000080:3.0:1790919568.295227:0:6439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135bf 00000020:00010000:3.0:1790919568.295236:0:6439:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f3b65b2800: total 0 00000100:00080000:3.0:1790919568.295240:0:6439:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b2000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790919568.295315:0:6439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a8157f22-2e62-481b-a08b-6545627fb184+3:2410:x1877914958281216:12345-192.168.203.11@tcp:251:umount.0 Request processed in 163us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919568.295323:0:6439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 387 00000020:00010000:1.0:1790919568.295869:0:6433:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f3b65b2800: total 0 00010000:00010000:1.0:1790919568.295914:0:6433:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f3b65b2800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790919568.295951:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c800/0x951c50ad15913698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38b1a expref: 2 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919568.295968:0:6433:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f3b65b2800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790919568.295980:0:6433:0:(genops.c:885:class_export_put()) final put ffff95f3b65b2800/a8157f22-2e62-481b-a08b-6545627fb184 00010000:00010000:1.0:1790919568.295996:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919568.296001:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919568.296003:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919568.296456:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b2800/a8157f22-2e62-481b-a08b-6545627fb184 for MGS 00000020:00000080:3.0:1790919568.296499:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65b2000 for MGS 00000001:00100000:0.0:1790919568.328037:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00000001:00080000:0.0:1790919568.328085:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1790919568.328091:0:6467:0:(genops.c:885:class_export_put()) final put ffff95f3a6ba9000/a0eadf68-44c6-442a-b15d-9a125194f9a5 00000001:00100000:0.0:1790919568.328108:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000001:00080000:0.0:1790919568.328112:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1790919568.328134:0:6467:0:(genops.c:885:class_export_put()) final put ffff95f2862eb800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:3.0:1790919568.328335:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a6ba9000/a0eadf68-44c6-442a-b15d-9a125194f9a5 for lustre-MDT0000 00000020:00000080:3.0:1790919568.328396:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862eb800/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-MDT0000 00000020:00000080:3.0:1790919568.328431:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3a6bac800 for lustre-MDT0000 00000020:00000080:3.0:1790919568.328436:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f398dc9800 for lustre-MDT0000 00010000:00010000:0.0:1790919568.805306:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790919568.868978:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:0.0:1790919568.868992:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f3b4713000/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:1.0:1790919568.869100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4713000/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-OST0000 00000020:00000080:1.0:1790919568.869170:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f398dcc000 for lustre-OST0000 00000001:00100000:1.0:1790919569.393176:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:1.0:1790919569.393197:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f3a690a000/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 00000020:00000080:2.0:1790919569.393318:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a690a000/fd078e75-25ee-44fe-89dc-39e9cfa5e4b5 for lustre-OST0001 00000020:00000080:2.0:1790919569.393450:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3a690e000 for lustre-OST0001 00010000:00010000:0.0:1790919569.822205:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790919569.953483:0:14741:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790919569.981229:0:14741:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790919569.981278:0:14741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919569.981293:0:14741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919569.981299:0:14741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919569.981306:0:14741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919569.981331:0:14741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790919569.981336:0:14741:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790919569.981360:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1790919569.981365:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1790919569.981377:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1790919569.981381:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.981393:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2da00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919569.981397:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.981409:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919569.981476:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919569.981483:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919569.981487:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790919569.981491:0:6433:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:3.0:1790919569.981551:0:14741:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919569.981577:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f3922a3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790919569.981651:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978240896:0@lo:39:umount.0 00000100:00100000:0.0:1790919569.981735:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919569.981980:0:6445:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978240896 00000100:00100000:0.0:1790919569.981988:0:6445:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978240896 00010000:00010000:2.0:1790919569.982599:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.982612:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919569.982647:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.982656:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2da00/0x951c50ad15913667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591366e expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.982676:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919569.982678:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919569.982680:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919569.982701:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978241024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919569.982791:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919569.982878:0:7709:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241024 00000100:00100000:2.0:1790919569.982885:0:7709:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241024 00000100:00100000:2.0:1790919569.982953:0:7709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919569.982964:0:7709:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3460:x1877914978241024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919569.982980:0:7709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919569.982999:0:7709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204b800/0x951c50ad1591366e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913667 expref: 24 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.983014:0:7709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919569.983132:0:7709:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3460:x1877914978241024:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919569.983143:0:7709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919569.983228:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978241024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919569.983271:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790919569.983284:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1877914978240896:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790919569.983316:0:6445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159131d6 00000100:00080000:0.0:1790919569.983324:0:6445:0:(import.c:65:import_set_state_nolock()) ffff95f3aeb6c800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790919569.983383:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919569.983444:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3457:x1877914978240896:12345-0@lo:39:umount.0 Request processed in 161us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919569.983452:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000020:00000080:0.0:1790919569.983464:0:6445:0:(genops.c:885:class_export_put()) final put ffff95f3bce51000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790919569.983498:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bce51000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1790919569.983543:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3aeb6c800 for lustre-MDT0000 00000100:00080000:2.0:1790919569.983601:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3922a3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790919569.983624:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978240896:0@lo:39:umount.0 00000100:00080000:0.0:1790919569.983737:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919569.983742:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790919569.983746:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790919569.987567:0:14741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987585:0:14741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987592:0:14741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987599:0:14741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987637:0:14741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919569.987644:0:14741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987651:0:14741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987657:0:14741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987663:0:14741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987756:0:14741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919569.987765:0:14741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987785:0:14741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987791:0:14741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.987796:0:14741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.987932:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790919569.987940:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.987948:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919569.987951:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.987961:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919569.987969:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919569.987986:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919569.987990:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790919569.988025:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988032:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919569.988090:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988098:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad15913675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591367c expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988110:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919569.988113:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988119:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919569.988122:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988129:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919569.988134:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919569.988138:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919569.988140:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790919569.988143:0:6433:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790919569.988167:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988172:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919569.988196:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988203:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15913579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913580 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988213:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919569.988216:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988221:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919569.988225:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988232:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919569.988237:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919569.988242:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790919569.988244:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1790919569.988256:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988261:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919569.988267:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988284:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919569.988286:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919569.988288:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919569.988318:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978241152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919569.988396:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919569.988462:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978241280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919569.988489:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919569.988513:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919569.988519:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978241408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919569.988544:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919569.988547:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241152 00000100:00100000:2.0:1790919569.988563:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241152 00000100:00100000:1.0:1790919569.988581:0:12731:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241280 00000100:00100000:1.0:1790919569.988590:0:12731:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241280 00000100:00100000:2.0:1790919569.988636:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241408 00000100:00100000:2.0:1790919569.988641:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241408 00000100:00100000:1.0:1790919569.988703:0:12731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919569.988714:0:12731:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1948390b-ad58-4044-9ddd-8f90f3aaa52f+25:3461:x1877914978241152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919569.988727:0:12731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919569.988741:0:12731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204bc00/0x951c50ad1591367c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913675 expref: 25 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919569.988760:0:12731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919569.988974:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919569.988986:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+24:3458:x1877914978241280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919569.989251:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919569.989271:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6486800/0x951c50ad15913580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913579 expref: 24 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.989307:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919569.989384:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+23:3458:x1877914978241280:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919569.989392:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919569.989416:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919569.989423:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+22:3458:x1877914978241408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919569.989432:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919569.989441:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1c000/0x951c50ad159138d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159138cf expref: 22 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.989452:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919569.989474:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+21:3458:x1877914978241408:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919569.989480:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919569.989975:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978241408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919569.989987:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978241280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919569.990165:0:12731:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3461:x1877914978241152:12345-0@lo:103:ldlm_bl.0 Request processed in 1446us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919569.990177:0:12731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1790919569.990375:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919569.990721:0:14741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790919569.990730:0:14741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d600/0x951c50ad159138cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159138d6 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919569.990745:0:14741:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790919569.990758:0:14741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.990765:0:14741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.990772:0:14741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.990778:0:14741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919569.990801:0:14741:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790919569.990805:0:14741:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790919569.990809:0:14741:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790919569.990924:0:14741:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790919569.990928:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790919569.990933:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919569.990938:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1790919569.990943:0:14741:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f3b6107800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919569.990949:0:14741:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f383f2e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919569.990953:0:14741:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f3b600b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919569.990957:0:14741:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f3b4514000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1790919569.990961:0:14741:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff95f38d584d40) has exports, disconnecting them 00000020:00080000:0.0:1790919569.990965:0:14741:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f3b6107800), last request at 1790919567 00000020:00000080:0.0:1790919569.990973:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159134e6 00010000:00010000:2.0:1790919569.990988:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1790919569.990990:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f3b6103000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790919569.991002:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.991014:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919569.991019:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.991031:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790919569.991092:0:14741:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3b6107800): rc 0 00000020:00000080:0.0:1790919569.991101:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3b6107800/lustre-MDT0000-lwp-OST0001_UUID 10000000:00010000:2.0:1790919569.991107:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919569.991116:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:0.0:1790919569.991118:0:14741:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f383f2e800), last request at 1790919567 10000000:01000000:2.0:1790919569.991123:0:6434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790919569.991131:0:6434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:0.0:1790919569.991131:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159133a4 00000100:00080000:0.0:1790919569.991143:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f2843f6000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1790919569.991157:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6107800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1790919569.991190:0:6434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.991200:0:6434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1790919569.991212:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b6103000 for lustre-MDT0000 00010000:00010000:2.0:1790919569.991224:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.991234:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f380030400/0x951c50ad15913135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591313c expref: -99 pid: 6426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790919569.991236:0:14741:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f383f2e800): rc 0 00000020:00000080:0.0:1790919569.991243:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f383f2e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1790919569.991261:0:14741:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f3b600b800), last request at 1790919370 00010000:00010000:2.0:1790919569.991264:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790919569.991266:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159132fc 00010000:00010000:2.0:1790919569.991269:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919569.991274:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f3b6008800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790919569.991275:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919569.991300:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978241536:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1790919569.991300:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f383f2e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1790919569.991374:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919569.991461:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3461:1877914978241152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919569.991481:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919569.991592:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919569.991830:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790919569.992010:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f2843f6000 for lustre-MDT0000 00000020:00080000:0.0:1790919569.992032:0:14741:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3b600b800): rc 0 00000020:00000080:0.0:1790919569.992047:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3b600b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1790919569.992080:0:14741:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f3b4514000), last request at 1790919370 00000020:00000080:0.0:1790919569.992088:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159132bd 00000100:00080000:0.0:1790919569.992094:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f3b600d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919569.992113:0:14741:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:2.0:1790919569.992123:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241536 00000100:00100000:2.0:1790919569.992135:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241536 00000100:00100000:2.0:1790919569.992209:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919569.992224:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+20:3460:x1877914978241536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919569.992242:0:6431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919569.992274:0:6431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697a00/0x951c50ad1591313c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913135 expref: 20 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919569.992293:0:6431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919569.992353:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3460:x1877914978241536:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919569.992363:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919569.992420:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978241536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919569.992448:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790919569.992474:0:14741:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3b4514000): rc 0 00000004:00000080:0.0:1790919569.992482:0:14741:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa204c2c23ae0 00000100:00080000:0.0:1790919569.992499:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790919569.992503:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1790919569.993527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b600b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790919569.993594:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b6008800 for lustre-MDT0000 00000100:00080000:0.0:1790919569.993935:0:14741:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790919569.993960:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f3be274800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790919569.994137:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978241664:0@lo:39:umount.0 00000100:00100000:2.0:1790919569.994218:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919569.994308:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241664 00000100:00100000:0.0:1790919569.994316:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241664 00000100:00100000:0.0:1790919569.994367:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790919569.994378:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1877914978241664:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790919569.994405:0:7568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591330a 00000100:00080000:0.0:1790919569.994412:0:7568:0:(import.c:65:import_set_state_nolock()) ffff95f3b65dc800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790919569.994429:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790919569.994431:0:7568:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1790919569.994628:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3457:x1877914978241664:12345-0@lo:39:umount.0 Request processed in 242us (400us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790919569.994637:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1790919569.994751:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3be274800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790919569.994758:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978241664:0@lo:39:umount.0 00000100:00080000:0.0:1790919569.995362:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790919569.995367:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1790919569.995381:0:14741:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790919569.995439:0:14741:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790919569.995457:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f383f2a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790919569.995500:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978241792:0@lo:9:umount.0 00000100:00100000:2.0:1790919569.995542:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919569.995601:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241792 00000100:00100000:3.0:1790919569.995606:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241792 00000100:00100000:3.0:1790919569.995657:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790919569.995665:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3457:x1877914978241792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790919569.995684:0:8248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591345a 00000100:00080000:3.0:1790919569.995691:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f3b6251800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919569.995717:0:8248:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1790919569.996138:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790919569.996141:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1790919569.996189:0:14741:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790919569.996247:0:14741:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790919569.996258:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f38716d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790919569.996311:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978241920:0@lo:9:umount.0 00000100:00100000:2.0:1790919569.996338:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919569.996401:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978241920 00000100:00100000:1.0:1790919569.996407:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978241920 00000100:00100000:1.0:1790919569.996451:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790919569.996461:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3457:x1877914978241920:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790919569.996477:0:8082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135aa 00000100:00080000:1.0:1790919569.996485:0:8082:0:(import.c:65:import_set_state_nolock()) ffff95f2862ed000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919569.996511:0:8082:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1790919569.996769:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3457:x1877914978241920:12345-0@lo:9:umount.0 Request processed in 309us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919569.996777:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919569.998255:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3457:x1877914978241792:12345-0@lo:9:umount.0 Request processed in 2585us (2706us total) trans 0 rc 0/0 00000020:00080000:0.0:1790919569.998255:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95f38d584d40) has no exports 00000100:00100000:3.0:1790919569.998265:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1790919569.998299:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919569.998304:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790919569.998319:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919569.999411:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919569.999677:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f2a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790919569.999768:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790919569.999771:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919569.999777:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978241792:0@lo:9:umount.0 00000100:00080000:2.0:1790919569.999819:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f38716d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790919569.999912:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790919570.000217:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919570.000223:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978241920:0@lo:9:umount.0 00000020:00080000:0.0:1790919570.008835:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95f38d584d40) has no exports 00000020:00000080:0.0:1790919570.085041:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913190 00000020:00000080:0.0:1790919570.085178:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3b4040800/lustre-QMT0000_UUID 00000020:01000000:0.0:1790919570.085243:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790919570.085322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4040800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790919570.085363:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919570.085375:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790919570.085380:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff95f3bce43380) has no exports 00000020:00000080:2.0:1790919570.089827:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913189 00000020:00000080:2.0:1790919570.089838:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bce50000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790919570.089911:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919570.089921:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790919570.089924:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bc16f800/lustre-QMT0000_UUID 00000020:00000080:2.0:1790919570.089927:0:14741:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc16f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790919570.089932:0:14741:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1790919570.091037:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bce50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000040:00080000:2.0:1790919570.140700:0:13305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790919570.332644:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978242048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919570.332717:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919570.332823:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242048 00000100:00100000:0.0:1790919570.332836:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242048 00000100:00100000:0.0:1790919570.332877:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790919570.332884:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3461:x1877914978242048:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1790919570.332891:0:6451:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790919570.332944:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3461:x1877914978242048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (226us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790919570.332951:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:02020000:2.0:1790919570.333168:0:3461:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1790919570.343674:0:3461:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790919570.343682:0:3461:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790919570.343688:0:3461:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790919570.354005:0:3461:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919570.354020:0:3461:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 179 00000100:00080000:2.0:1790919570.354036:0:3461:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95f3bc037800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919570.354104:0:3461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aa9f80 x1877914978242176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919570.354254:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978242176:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790919570.354322:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919570.354413:0:7568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242176 00000100:00100000:0.0:1790919570.354421:0:7568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242176 00000100:00100000:0.0:1790919570.354459:0:7568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790919570.354466:0:7568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3457:x1877914978242176:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1790919570.354481:0:7568:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790919570.358616:0:7568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3457:x1877914978242176:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 4139us (4283us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790919570.358631:0:7568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1790919570.358806:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919570.358812:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919570.358815:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978242176:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1790919570.844551:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919570.844811:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978242304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919570.844910:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919570.845270:0:8087:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242304 00000100:00100000:3.0:1790919570.845283:0:8087:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242304 00000100:00100000:3.0:1790919570.845407:0:8087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790919570.845419:0:8087:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978242304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919570.845490:0:8087:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919570.845562:0:8087:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978242304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919570.845571:0:8087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790919570.845716:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978242304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790919570.845824:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919571.868374:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919572.382430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790919572.382439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1790919572.382442:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1790919572.382445:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919572.382457:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 379 00000100:00100000:3.0:1790919572.382464:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978242432:0@lo:400:kworker.0 00000100:00080000:1.0:1790919572.382473:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790919572.382492:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95f3bc037800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919572.382521:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285a9a300 x1877914978242560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919572.382562:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.382635:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978242944:0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.382642:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978243072:0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.382670:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919572.382691:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.382697:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978243456:0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.382767:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243072 00000100:00100000:1.0:1790919572.382775:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243072 00000100:00100000:3.0:1790919572.382799:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.382833:0:6440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242432 00000100:00100000:3.0:1790919572.382836:0:6440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242432 00000100:00100000:1.0:1790919572.382838:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243456 00000100:00100000:1.0:1790919572.382843:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243456 00000100:00100000:3.0:1790919572.382866:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1790919572.382875:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790919572.382877:0:6440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3458:x1877914978242432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.382889:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978243072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.382928:0:6440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1948390b-ad58-4044-9ddd-8f90f3aaa52f+19:3458:x1877914978242432:12345-0@lo:400:kworker.0 Request processed in 54us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919572.382934:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1790919572.382951:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978243072:12345-0@lo:400:kworker.0 Request processed in 65us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919572.382959:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790919572.382966:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242944 00000100:00100000:3.0:1790919572.382969:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242944 00000100:00100000:1.0:1790919572.382981:0:8082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790919572.382988:0:8082:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978243456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.383017:0:8082:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978243456:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919572.383023:0:8082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1790919572.383042:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919572.383047:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919572.383049:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919572.383110:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790919572.383115:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978243072:0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.383129:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978242944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.383180:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978242944:12345-0@lo:400:kworker.0 Request processed in 62us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919572.383183:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978242688:0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.383192:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790919572.383218:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919572.383251:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978243200:0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.383276:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919572.383298:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919572.383305:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978242816:0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.383329:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919572.383349:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978243328:0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.383389:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.383407:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242688 00000100:00100000:3.0:1790919572.383418:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242688 00000100:00100000:3.0:1790919572.383432:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243200 00000100:00100000:3.0:1790919572.383435:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243200 00000100:00100000:3.0:1790919572.383443:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242816 00000100:00100000:3.0:1790919572.383445:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242816 00000100:00100000:3.0:1790919572.383452:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243328 00000100:00100000:3.0:1790919572.383454:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243328 00000100:00100000:3.0:1790919572.383478:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1790919572.383484:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978243328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919572.383657:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978242560:0@lo:38:kworker.0 00000100:00100000:1.0:1790919572.383722:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790919572.383728:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978243328:12345-0@lo:400:kworker.0 Request processed in 242us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919572.384088:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1877914978242688:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790919572.384096:0:6445:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790919572.384136:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1877914978242688:12345-0@lo:400:kworker.0 Request processed in 47us (918us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790919572.384143:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1790919572.384153:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790919572.384177:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790919572.384184:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3460:x1877914978243200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919572.384186:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000020:00080000:3.0:1790919572.384198:0:6447:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790919572.384199:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1877914978242816:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790919572.384207:0:6445:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790919572.384236:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3460:x1877914978243200:12345-0@lo:400:kworker.0 Request processed in 50us (958us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790919572.384243:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790919572.384259:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3460:x1877914978242816:12345-0@lo:400:kworker.0 Request processed in 61us (927us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919572.384265:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1790919572.384322:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919572.384351:0:3460:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790919572.384358:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790919572.384363:0:3460:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:3.0:1790919572.384785:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285a98380 x1877914978242944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919572.384801:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978242944:0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.384816:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978243456:0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.384827:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978242432:0@lo:400:kworker.0 00000100:00100000:0.0:1790919572.385374:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919572.385458:0:6450:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978242560 00000100:00100000:0.0:1790919572.385481:0:6450:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978242560 00000100:00100000:0.0:1790919572.385518:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790919572.385526:0:6450:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978242560:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1790919572.385546:0:6450:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790919572.386669:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919572.386688:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978243584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919572.386753:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.386889:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243584 00000100:00100000:3.0:1790919572.386897:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243584 00000100:00100000:3.0:1790919572.386941:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790919572.386950:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978243584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919572.387033:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919572.387172:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978243584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919572.387181:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790919572.387259:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978243584:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790919572.402539:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919572.402557:0:3460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 193 00000100:00080000:1.0:1790919572.402589:0:3460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f3b4715800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919572.403290:0:3460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860ff100 x1877914978243712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919572.403330:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978242816:0@lo:400:kworker.0 00010000:00080000:3.0:1790919572.403375:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54a300 x1877914978243328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919572.403389:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978243328:0@lo:400:kworker.0 00000100:00080000:3.0:1790919572.403407:0:3460:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790919572.403413:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790919572.403417:0:3460:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790919572.403421:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919572.403425:0:3460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 179 00000100:00080000:3.0:1790919572.403433:0:3460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff95f3b600c800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919572.403447:0:3460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fca80 x1877914978243840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919572.403458:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978242688:0@lo:400:kworker.0 00000100:00080000:3.0:1790919572.403472:0:3460:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790919572.403494:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790919572.403498:0:3460:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790919572.403501:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919572.403505:0:3460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 209 00000100:00080000:3.0:1790919572.403511:0:3460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f2862e9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919572.403525:0:3460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fd180 x1877914978243968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919572.403535:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978243200:0@lo:400:kworker.0 00000100:00100000:3.0:1790919572.403602:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978243712:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790919572.403684:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.403719:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978243840:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790919572.404048:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243712 00000100:00100000:2.0:1790919572.404076:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243712 00000100:00100000:2.0:1790919572.404129:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790919572.404139:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978243712:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1790919572.404182:0:6447:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790919572.404239:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978243712:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 100us (555us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919572.404247:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790919572.405043:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919572.405099:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978243968:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790919572.405125:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919572.405181:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919572.405187:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919572.405191:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978243712:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790919572.405347:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243840 00000100:00100000:1.0:1790919572.405354:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243840 00000100:00100000:1.0:1790919572.405384:0:7785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978243968 00000100:00100000:1.0:1790919572.405387:0:7785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978243968 00000100:00100000:1.0:1790919572.405404:0:7785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790919572.405410:0:7785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3457:x1877914978243840:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1790919572.405442:0:7785:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790919572.405560:0:10757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790919572.405576:0:10757:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3457:x1877914978243968:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1790919572.405584:0:10757:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790919572.406246:0:7785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3457:x1877914978243840:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 832us (1204us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790919572.406256:0:7785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790919572.411752:0:10757:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3457:x1877914978243968:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 6171us (6611us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919572.411773:0:10757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1790919572.414803:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919572.414823:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790919572.414829:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978243840:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1790919572.414862:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919572.414867:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790919572.414872:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978243968:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790919572.424043:0:6450:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978242560:12345-0@lo:38:kworker.0 Request processed in 38505us (38660us total) trans 0 rc -19/-19 00000100:00080000:2.0:1790919572.424175:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919572.424185:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919572.424190:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978242560:0@lo:38:kworker.0 00000100:00100000:0.0:1790919572.425599:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000001:00100000:0.0:1790919572.509707:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790919572.509739:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1790919572.509747:0:7248:0:(genops.c:885:class_export_put()) final put ffff95f3b65de000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790919572.510403:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a0eadf68-44c6-442a-b15d-9a125194f9a5 00000001:00080000:0.0:1790919572.510415:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1790919572.510419:0:7248:0:(genops.c:885:class_export_put()) final put ffff95f3b65b5800/a0eadf68-44c6-442a-b15d-9a125194f9a5 00000020:00000080:2.0:1790919572.512119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65de000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1790919572.512403:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65dc800 for lustre-MDT0001 00000020:00000080:2.0:1790919572.512652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b5800/a0eadf68-44c6-442a-b15d-9a125194f9a5 for lustre-MDT0001 00000020:00000080:2.0:1790919572.512771:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65b1800 for lustre-MDT0001 00010000:00010000:0.0:1790919572.893199:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790919573.443212:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790919573.443226:0:6467:0:(genops.c:885:class_export_put()) final put ffff95f3b4514000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790919573.443339:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4514000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1790919573.443423:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b600d000 for lustre-MDT0000 00010000:00010000:1.0:1790919573.917225:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919573.968565:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790919573.968578:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f3b6252800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919573.968731:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6252800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790919573.968808:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b6251800 for lustre-OST0000 00000001:00100000:2.0:1790919574.475524:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919574.475538:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f2862ea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919574.475619:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862ea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790919574.475684:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f2862ed000 for lustre-OST0001 00010000:00010000:3.0:1790919574.940359:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919575.965747:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978244096:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790919575.965815:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919575.965849:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919575.965941:0:8565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244096 00000100:00100000:0.0:1790919575.965952:0:8565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244096 00000100:00100000:0.0:1790919575.966047:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790919575.966099:0:8565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978244096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919575.966155:0:8565:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919575.966220:0:8565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978244096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919575.966228:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790919575.966480:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978244096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790919575.966910:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:2.0:1790919576.156345:0:14741:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f382e40660 - data ffff95f38eba0798/ffff95f3b67fdc00 00000020:01000000:2.0:1790919576.156522:0:14741:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f383d3bae0 - data ffff95f38eb3e360/ffff95f3bce7dc00 00000001:00000004:2.0:1790919576.167674:0:14741:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1790919576.235939:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790919576.235952:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1790919576.235974:0:14741:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff95f285599500 x1877914978241664/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790919579 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919576.236006:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790919576.241307:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919576.241318:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1790919576.241351:0:14741:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919576.241355:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790919576.244010:0:8244:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790919576.244020:0:8244:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1790919576.244048:0:8244:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790919576.245664:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919576.245673:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1790919576.245692:0:14741:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919576.245695:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790919576.246024:0:9500:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790919576.246030:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1790919576.246041:0:9500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1790919576.368697:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913158 00000020:00000080:1.0:1790919576.368773:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f38d598800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790919576.370027:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591316d 00000020:00000080:1.0:1790919576.370040:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bc168000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919576.370149:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f38d598800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790919576.372376:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1790919576.372395:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919576.372408:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790919576.372414:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff95f38d583380) has no exports 00000004:01000000:1.0:1790919576.372631:0:14741:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790919576.372643:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159135a3 00000020:00000080:1.0:1790919576.372653:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3b65b6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919576.372909:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc168000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790919576.372986:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790919576.372992:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919576.373018:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790919576.373021:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff95f3bbb699c0) has no exports 00000020:00000080:1.0:1790919576.373030:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591359c 00000020:00000080:1.0:1790919576.373035:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f387169000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790919576.373078:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1790919576.373853:0:14741:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790919576.373860:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790919576.373866:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1790919576.373874:0:14741:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790919576.373876:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919576.373922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f387169000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790919576.374028:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919576.374040:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790919576.374049:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913453 00000020:00000080:1.0:1790919576.374088:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bbc86800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919576.374175:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f38716d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790919576.374183:0:8:0:(genops.c:885:class_export_put()) final put ffff95f3b64f7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919576.374186:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b64f7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790919576.374192:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790919576.374417:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790919576.374424:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919576.374431:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790919576.374435:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff95f3bbfd8000) has no exports 00000020:00000080:1.0:1790919576.374442:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591344c 00000020:00000080:1.0:1790919576.374447:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3b6252000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790919576.374469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bbc86800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790919576.374623:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6252000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790919576.375089:0:14741:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790919576.375098:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790919576.375102:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1790919576.375107:0:14741:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790919576.375108:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790919576.375207:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919576.375217:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919576.375219:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f383f2a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790919576.375226:0:8:0:(genops.c:885:class_export_put()) final put ffff95f284002800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790919576.375229:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284002800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000004:01000000:1.0:1790919576.375235:0:14741:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:01000000:0.0:1790919576.375235:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790919576.375241:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913293 00000020:00000080:1.0:1790919576.375248:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bb589800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790919576.375263:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1790919576.375266:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919576.375271:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790919576.375284:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff95f3bdfe4d40) has no exports 00000020:00000080:1.0:1790919576.375289:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591328c 00000020:00000080:1.0:1790919576.375294:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3be270000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790919576.375303:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bb589800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1790919576.375312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3be270000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790919576.376696:0:14741:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790919576.376800:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790919576.376805:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1790919576.376812:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790919576.376914:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919576.376927:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790919576.376967:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919576.376972:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790919576.376979:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bb58a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790919576.376984:0:14741:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bb58a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790919576.376993:0:14741:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790919576.377146:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913174 00000020:00000080:1.0:1790919576.377155:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bc16e800/lustre-MDD0000_UUID 00000020:00000080:2.0:1790919576.377220:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3be274800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1790919576.377229:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3bc036000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919576.377232:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc036000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1790919576.377246:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790919576.377805:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790919576.377948:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc16e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790919576.378009:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919576.378018:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790919576.378024:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff95f38d580000) has no exports 00000020:00000080:0.0:1790919576.378085:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919576.378091:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790919576.378095:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bb58e800/lustre-MDD0000_UUID 00000020:00000080:0.0:1790919576.378097:0:14741:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bb58e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790919576.378103:0:14741:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790919576.378219:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591317b 00000020:00000080:0.0:1790919576.378225:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bc16e000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790919576.378263:0:14741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f385571800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790919576.378267:0:14741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385571800 3 00000020:01000004:0.0:1790919576.378275:0:14741:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f385571800 from lustre-MDT0000 00000020:00000080:2.0:1790919576.378305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc16e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790919576.378343:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919576.378347:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790919576.378351:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f38d59b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1790919576.378353:0:14741:0:(genops.c:844:class_export_destroy()) destroying export ffff95f38d59b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790919576.378364:0:14741:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790919576.378396:0:14741:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1790919576.378401:0:14741:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790919576.378405:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790919576.378407:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919576.378411:0:14741:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790919576.378419:0:14741:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff95f391984800 1948390b-ad58-4044-9ddd-8f90f3aaa52f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919576.378425:0:14741:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff95f3a6878000) has exports, disconnecting them 00000020:00080000:0.0:1790919576.378431:0:14741:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95f391984800), last request at 1790919355 00000020:00000080:0.0:1790919576.378450:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913119 00000020:00010000:0.0:1790919576.378455:0:14741:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f391984800: total 0 00000100:00080000:0.0:1790919576.378460:0:14741:0:(import.c:65:import_set_state_nolock()) ffff95f391982000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790919576.378488:0:14741:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f391984800): rc 0 00000020:00080000:0.0:1790919576.378493:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff95f3a6878000) has no exports 00000100:00100000:0.0:1790919576.378570:0:6438:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff95f382e54600:6438] 0 exiting: rc = 1 00000020:00010000:2.0:1790919576.378758:0:6433:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f391984800: total 0 00010000:00010000:2.0:1790919576.378787:0:6433:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f391984800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790919576.378821:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6487200/0x951c50ad15913644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad1591363d expref: 14 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378838:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6486200/0x951c50ad15913652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad1591364b expref: 13 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378850:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2ca00/0x951c50ad15913660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913659 expref: 12 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378867:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697c00/0x951c50ad15913215 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad1591320e expref: 11 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378886:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697000/0x951c50ad15913223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad1591321c expref: 10 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378898:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2d400/0x951c50ad159138ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159138a5 expref: 9 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378925:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2ce00/0x951c50ad159138ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159138b3 expref: 8 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378936:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014400/0x951c50ad1591368a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913683 expref: 7 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378947:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014200/0x951c50ad1591361a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913613 expref: 6 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378958:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204a000/0x951c50ad159138c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159138c1 expref: 5 pid: 6440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378972:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015200/0x951c50ad1591353a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913533 expref: 4 pid: 6438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378986:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3c204be00/0x951c50ad15913628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15913621 expref: 3 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.378997:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014000/0x951c50ad15913636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad1591362f expref: 2 pid: 6439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919576.379008:0:6433:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f391984800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1790919576.379022:0:6433:0:(genops.c:885:class_export_put()) final put ffff95f391984800/1948390b-ad58-4044-9ddd-8f90f3aaa52f 00010000:00010000:2.0:1790919576.379045:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919576.379048:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919576.379072:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790919576.379218:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f391984800/1948390b-ad58-4044-9ddd-8f90f3aaa52f for MGS 00000020:00000080:0.0:1790919576.379262:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f391982000 for MGS 00000100:00100000:3.0:1790919576.379719:0:6440:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff95f38d4bde00:6440] 2 exiting: rc = 0 00000100:00100000:3.0:1790919576.379821:0:6439:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff95f38d4bd800:6439] 1 exiting: rc = 0 00000100:00100000:0.0:1790919576.379919:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.379930:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.379941:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.379951:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.379961:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.379982:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.379991:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380001:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380010:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380018:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380027:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380035:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380043:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380079:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380089:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380097:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380107:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380117:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380126:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380131:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380151:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380157:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380164:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380170:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380177:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380184:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380190:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380197:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380204:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380210:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380216:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380223:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380229:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380237:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380243:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380249:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380269:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380278:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380289:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380295:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380319:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380325:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380331:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380336:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380343:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380348:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380373:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380384:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380391:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380438:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380445:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380451:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380457:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380472:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380480:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380486:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380492:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380499:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380505:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380511:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380518:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380524:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380531:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919576.380545:0:14741:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790919576.381243:0:14741:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790919576.381247:0:14741:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1790919576.383107:0:14741:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f284c06660 - data ffff95f3bdb1daf8/ffff95f283ac5000 00000020:01000000:0.0:1790919576.383304:0:14741:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f395764720 - data ffff95f38eb39798/ffff95f38d404000 00000020:00000080:0.0:1790919576.384154:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159130fd 00000020:00000080:0.0:1790919576.384166:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3922e5800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790919576.384186:0:14741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f385571800 from MGS, refs=2 00000020:01000004:0.0:1790919576.384191:0:14741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385571800 2 00000020:01000004:0.0:1790919576.384194:0:14741:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f385571800 from MGS 00000020:00000080:0.0:1790919576.384227:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919576.384248:0:14741:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790919576.384253:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f385573800/MGS 00000020:00000080:0.0:1790919576.384256:0:14741:0:(genops.c:844:class_export_destroy()) destroying export ffff95f385573800/MGS for MGS 00000020:01000000:0.0:1790919576.384265:0:14741:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1790919576.384518:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3922e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790919576.384668:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790919576.384674:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919576.384682:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790919576.384692:0:14741:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95f3bce56000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919576.384802:0:14741:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff95f3a68b8000) has exports, disconnecting them 00000020:00080000:0.0:1790919576.384810:0:14741:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95f3bce56000), last request at 1790919356 00000020:00000080:0.0:1790919576.384817:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159131c8 00000020:00080000:0.0:1790919576.384831:0:14741:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3bce56000): rc 0 00000020:00000080:0.0:1790919576.384837:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f3bce56000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790919576.386155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bce56000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790919576.399320:0:14741:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790919576.399401:0:14741:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790919576.399408:0:14741:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790919576.399418:0:14741:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790919576.400284:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919576.400299:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790919576.400309:0:14741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385571800 1 00000020:00000080:1.0:1790919576.400317:0:14741:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159130ef 00000020:00000080:1.0:1790919576.400330:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f385575800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790919576.400348:0:14741:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790919576.400355:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919576.400360:0:14741:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790919576.400365:0:14741:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff95f3908a99c0) has no exports 00000020:00000080:2.0:1790919576.401221:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3922a3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790919576.401250:0:8:0:(genops.c:885:class_export_put()) final put ffff95f3b4046000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790919576.401254:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4046000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1790919576.401272:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1790919576.401357:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f385575800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919576.429262:0:14741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919576.429282:0:14741:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790919576.429289:0:14741:0:(genops.c:885:class_export_put()) final put ffff95f385c12800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790919576.429295:0:14741:0:(genops.c:844:class_export_destroy()) destroying export ffff95f385c12800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790919576.429307:0:14741:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790919576.429678:0:14741:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f385573000 00000020:02000400:3.0:1790919576.429789:0:14741:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1790919576.988372:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919577.500253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790919577.500260:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790919577.500264:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919577.500272:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 381 00000100:00080000:2.0:1790919577.500278:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790919577.500290:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95f3bc037800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919577.500313:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aaaa00 x1877914978244352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919577.500330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790919577.500333:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790919577.500336:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919577.500339:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 381 00000100:00080000:2.0:1790919577.500342:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919577.500346:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff95f3b600c800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919577.500359:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aa9f80 x1877914978244480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919577.500369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790919577.500373:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790919577.500374:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919577.500378:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 381 00000100:00080000:2.0:1790919577.500381:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919577.500394:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f3b4715800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919577.500407:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aaad80 x1877914978244608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919577.500441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790919577.500444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790919577.500446:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919577.500450:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 381 00000100:00080000:2.0:1790919577.500452:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919577.500457:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f2862e9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919577.500468:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aa8000 x1877914978244992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919577.500527:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978245120:0@lo:400:kworker.0 00000100:00100000:2.0:1790919577.500585:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.500689:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790919577.500695:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978244224:0@lo:400:kworker.0 00000400:00000100:2.0:1790919577.500712:0:3460:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877914978244224 offset 0 length 224: 4 00000100:00100000:2.0:1790919577.500729:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978245248:0@lo:400:kworker.0 00000100:00100000:2.0:1790919577.500753:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.500790:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978244352:0@lo:38:kworker.0 00000100:00100000:1.0:1790919577.500795:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245120 00000100:00100000:1.0:1790919577.500803:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245120 00000100:00100000:2.0:1790919577.500814:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.500832:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978244480:0@lo:38:kworker.0 00000100:00100000:2.0:1790919577.500853:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.500868:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978244608:0@lo:38:kworker.0 00000100:00100000:2.0:1790919577.500887:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.500922:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978244992:0@lo:38:kworker.0 00000100:00100000:2.0:1790919577.500945:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.500976:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978244736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919577.501013:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919577.501022:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244480 00000100:00100000:1.0:1790919577.501026:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244480 00000100:00100000:2.0:1790919577.501029:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978245376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919577.501038:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244608 00000100:00100000:1.0:1790919577.501040:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244608 00000100:00100000:1.0:1790919577.501048:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244992 00000100:00100000:2.0:1790919577.501066:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919577.501076:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244992 00000100:00100000:2.0:1790919577.501086:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919577.501086:0:6447:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244736 00000100:00100000:1.0:1790919577.501089:0:6447:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244736 00000100:00100000:2.0:1790919577.501092:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978244864:0@lo:400:kworker.0 00000100:00100000:2.0:1790919577.501113:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919577.501150:0:8082:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245248 00000100:00100000:2.0:1790919577.501153:0:8082:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245248 00000100:00080000:3.0:1790919577.506538:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919577.506547:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919577.506639:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1790919577.506652:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978245120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919577.506767:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978245120:12345-0@lo:400:kworker.0 Request processed in 119us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919577.506776:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1790919577.506798:0:6447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1790919577.506807:0:6447:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978244736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919577.506852:0:6447:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978244736:12345-0@lo:400:kworker.0 Request processed in 47us (5839us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919577.506858:0:6447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:1.0:1790919577.506907:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff95f285aa9180 x1877914978244736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919577.506922:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978244736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919577.507369:0:6451:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244352 00000100:00100000:2.0:1790919577.507377:0:6451:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244352 00000100:00100000:2.0:1790919577.507405:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790919577.507411:0:6451:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978244352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790919577.507505:0:6451:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790919577.507555:0:6451:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978244352:12345-0@lo:38:kworker.0 Request processed in 143us (6739us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919577.507562:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790919577.507588:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790919577.507593:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978244480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790919577.507603:0:6445:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790919577.507630:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978244480:12345-0@lo:38:kworker.0 Request processed in 36us (6777us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919577.507636:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790919577.507649:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790919577.507665:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978244608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790919577.507675:0:6445:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790919577.507701:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978244608:12345-0@lo:38:kworker.0 Request processed in 36us (6814us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919577.507707:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790919577.507720:0:6445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790919577.507724:0:6445:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978244992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790919577.507733:0:6445:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790919577.507756:0:6445:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978244992:12345-0@lo:38:kworker.0 Request processed in 30us (6810us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919577.507761:0:6445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790919577.507824:0:8086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245376 00000100:00100000:2.0:1790919577.507829:0:8086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245376 00000100:00100000:2.0:1790919577.507855:0:8086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790919577.507862:0:8086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3458:x1877914978245376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919577.507891:0:8086:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919577.508367:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978245376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919577.509072:0:8083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978244864 00000100:00100000:3.0:1790919577.509080:0:8083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978244864 00000100:00100000:3.0:1790919577.509137:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790919577.509147:0:8083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978245248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919577.509485:0:8086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3458:x1877914978245376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1620us (8431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919577.509495:0:8086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790919577.509600:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790919577.509611:0:8084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978244864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919577.511183:0:8083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978245248:12345-0@lo:400:kworker.0 Request processed in 2031us (10422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919577.511194:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1790919577.511231:0:6441:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919577.511268:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978245248:0@lo:400:kworker.0 00010000:00080000:3.0:1790919577.511283:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff95f3b606bb80 x1877914978245120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919577.511309:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978245120:0@lo:400:kworker.0 00000100:00080000:2.0:1790919577.511556:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919577.511563:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919577.511567:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978244352:0@lo:38:kworker.0 00000100:00080000:2.0:1790919577.511579:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919577.511590:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919577.511594:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978244480:0@lo:38:kworker.0 00000100:00080000:2.0:1790919577.511608:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919577.511611:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919577.511614:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978244608:0@lo:38:kworker.0 00000100:00080000:2.0:1790919577.511636:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919577.511641:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919577.511644:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978244992:0@lo:38:kworker.0 00000100:00100000:2.0:1790919577.512325:0:8084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978244864:12345-0@lo:400:kworker.0 Request processed in 2713us (11207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919577.512337:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790919577.512363:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978244864:0@lo:400:kworker.0 00010000:00010000:3.0:1790919578.014277:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790919578.761782:0:14896:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790919578.774313:0:14896:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790919578.774362:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.774379:0:14896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.774386:0:14896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.774393:0:14896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.774420:0:14896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790919578.774425:0:14896:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790919578.774448:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919578.774464:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790919578.774470:0:14896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790919578.774475:0:14896:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790919578.774480:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919578.774482:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790919578.774485:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790919578.774609:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919578.774617:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919578.774635:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919578.774639:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919578.774648:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919578.774655:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919578.774660:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919578.774662:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790919578.774665:0:6433:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790919578.774700:0:6433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919578.774706:0:6433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790919578.774766:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1790919578.774786:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919578.774795:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d200/0x951c50ad1591364b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913652 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919578.774807:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919578.774809:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919578.774810:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919578.775386:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978245504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919578.775469:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919578.775569:0:13233:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245504 00000100:00100000:3.0:1790919578.775577:0:13233:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245504 00010000:00010000:2.0:1790919578.775722:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775732:0:14896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775739:0:14896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775745:0:14896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775767:0:14896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919578.775774:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775780:0:14896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775786:0:14896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775792:0:14896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775819:0:14896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790919578.775826:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775832:0:14896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775837:0:14896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775843:0:14896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775853:0:14896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790919578.775858:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775864:0:14896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775870:0:14896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775876:0:14896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919578.775883:0:14896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1790919578.775886:0:14896:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1790919578.775916:0:14896:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1790919578.775921:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1790919578.775925:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919578.775930:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1790919578.775936:0:14896:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff95f2862ee800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919578.775941:0:14896:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff95f3bc16a800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919578.775945:0:14896:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff95f3a687b380) has exports, disconnecting them 00000020:00080000:2.0:1790919578.775949:0:14896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff95f2862ee800), last request at 1790919577 00000020:00000080:2.0:1790919578.775956:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159134fb 00000100:00080000:2.0:1790919578.775974:0:14896:0:(import.c:65:import_set_state_nolock()) ffff95f2862ee000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790919578.776016:0:14896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f2862ee800): rc 0 00000020:00000080:2.0:1790919578.776019:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f2862ee800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1790919578.776028:0:14896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff95f3bc16a800), last request at 1790919577 00000020:00000080:2.0:1790919578.776031:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159133b9 00000100:00080000:2.0:1790919578.776037:0:14896:0:(import.c:65:import_set_state_nolock()) ffff95f3b6256800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1790919578.776047:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862ee800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1790919578.776113:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f2862ee000 for lustre-MDT0001 00000020:00080000:2.0:1790919578.776142:0:14896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3bc16a800): rc 0 00000020:00000080:2.0:1790919578.776144:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc16a800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1790919578.776156:0:14896:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa204c2f8fae0 00000100:00100000:3.0:1790919578.776165:0:13233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000020:00000080:2.0:1790919578.776168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc16a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:3.0:1790919578.776175:0:13233:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3458:x1877914978245504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790919578.776183:0:13233:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919578 with bad export cookie 10744551515320561945 00000020:00000080:2.0:1790919578.776197:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b6256800 for lustre-MDT0001 00000100:00080000:2.0:1790919578.776219:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919578.776228:0:14896:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff95f285aa9c00 x1877914978242048/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790919586 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919578.776244:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1790919578.776590:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790919578.776600:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.776610:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204a200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919578.776892:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.776904:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919578.776911:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919578.776931:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919578.776934:0:7708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1790919578.776936:0:7708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1790919578.776970:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790919578.776985:0:14896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1790919578.776989:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1790919578.776993:0:14896:0:(import.c:65:import_set_state_nolock()) ffff95f3bc037800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1790919578.777102:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777111:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204a200/0x951c50ad15913659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913660 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777137:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790919578.777141:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777147:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6486a00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919578.777150:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777157:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919578.777165:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919578.777169:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00080000:2.0:1790919578.777171:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 10000000:01000000:0.0:1790919578.777172:0:7708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:2.0:1790919578.777177:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 10000000:01000000:0.0:1790919578.777178:0:7708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000004:00080000:2.0:1790919578.777192:0:14896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1790919578.777202:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777210:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919578.777219:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777226:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6486a00/0x951c50ad15913533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591353a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777241:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919578.777245:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777251:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204a400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919578.777254:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777262:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790919578.777268:0:14896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 10000000:00010000:0.0:1790919578.777269:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919578.777277:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790919578.777279:0:7708:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790919578.777281:0:7708:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1790919578.777283:0:14896:0:(import.c:65:import_set_state_nolock()) ffff95f385587000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790919578.777295:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790919578.777297:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919578.777301:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1790919578.777308:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:2.0:1790919578.777313:0:14896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1790919578.777328:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777343:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204a400/0x951c50ad159138c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159138c8 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777355:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919578.777359:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777365:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030c00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919578.777368:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777376:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919578.777382:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919578.777388:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978245888:0@lo:9:umount.0 10000000:01000000:0.0:1790919578.777391:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919578.777396:0:7708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790919578.777398:0:7708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790919578.777414:0:7708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777421:0:7708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919578.777428:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919578.777435:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f380030c00/0x951c50ad1591321c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15913223 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919578.777455:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919578.777463:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919578.777466:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919578.777470:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919578.777494:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978245632:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790919578.777506:0:14896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790919578.777520:0:14896:0:(import.c:65:import_set_state_nolock()) ffff95f3b64f2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790919578.777536:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919578.777540:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978246272:0@lo:9:umount.0 00000100:00100000:2.0:1790919578.777574:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919578.777580:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919578.777591:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978245760:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1790919578.777626:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff95f3a687b380) has no exports 00000100:00100000:0.0:1790919578.777634:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919578.777670:0:6430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245632 00000100:00100000:0.0:1790919578.777686:0:6430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245632 00010000:00010000:1.0:1790919578.777870:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919578.777952:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978246016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919578.777997:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919578.778027:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919578.778034:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978246144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919578.778106:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919578.778151:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245760 00000100:00100000:1.0:1790919578.778156:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245760 00000100:00100000:1.0:1790919578.778170:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978246016 00000100:00100000:1.0:1790919578.778172:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978246016 00000100:00100000:1.0:1790919578.778179:0:6431:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978246144 00000100:00100000:1.0:1790919578.778182:0:6431:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978246144 00000100:00100000:1.0:1790919578.778194:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790919578.778201:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3460:x1877914978245632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790919578.778207:0:6431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919578 with bad export cookie 10744551515320561945 00000100:00100000:1.0:1790919578.778250:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3460:x1877914978245632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (715us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919578.778257:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790919578.778273:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919578.778277:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3460:x1877914978245760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790919578.778281:0:6431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919578 with bad export cookie 10744551515320561945 00000100:00100000:1.0:1790919578.778305:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3460:x1877914978245760:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (673us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919578.778311:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919578.778323:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919578.778327:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3458:x1877914978246016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790919578.778330:0:6431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919578 with bad export cookie 10744551515320561945 00000100:00100000:1.0:1790919578.778358:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3458:x1877914978246016:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (361us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919578.778364:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919578.778375:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919578.778388:0:6431:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a68ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3458:x1877914978246144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790919578.778392:0:6431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919578 with bad export cookie 10744551515320561945 00000100:00100000:1.0:1790919578.778419:0:6431:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a68ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3458:x1877914978246144:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (313us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919578.778425:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790919578.778454:0:3458:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790919578.778457:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790919578.778460:0:3458:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1790919578.780224:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978242048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790919578.780264:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919578.782146:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978245888 00000100:00100000:2.0:1790919578.782159:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978245888 00000100:00100000:2.0:1790919578.782212:0:8248:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978246272 00000100:00100000:2.0:1790919578.782216:0:8248:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978246272 00000100:00100000:2.0:1790919578.782243:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919578.782253:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3457:x1877914978245888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790919578.782282:0:8248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913406 00000100:00080000:2.0:1790919578.782293:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f2843f1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790919578.782329:0:8248:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790919578.782703:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3457:x1877914978245888:12345-0@lo:9:umount.0 Request processed in 451us (5247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919578.782724:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919578.782740:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919578.782747:0:8248:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3457:x1877914978246272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790919578.782760:0:8248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913564 00000100:00080000:2.0:1790919578.782774:0:8248:0:(import.c:65:import_set_state_nolock()) ffff95f3a6bac000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790919578.782799:0:8248:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790919578.783014:0:8248:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3457:x1877914978246272:12345-0@lo:9:umount.0 Request processed in 266us (5440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919578.783021:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1790919578.783171:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b64f2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790919578.783185:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790919578.783187:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919578.783191:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978246272:0@lo:9:umount.0 00000100:00080000:2.0:1790919578.783204:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f385587000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790919578.783211:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790919578.783213:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919578.783296:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978245888:0@lo:9:umount.0 00010000:00010000:2.0:1790919578.783338:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919578.790786:0:3460:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1790919578.791274:0:13233:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3458:x1877914978245504:12345-0@lo:103:ldlm_bl.0 Request processed in 15097us (15802us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790919578.791287:0:13233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1790919578.791963:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919578.810373:0:3458:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790919578.810378:0:3458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790919578.810387:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f285aa8700 x1877914978244224/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790919593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919578.810401:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f38d548700 x1877914978245504/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919594 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919578.810410:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f28559aa00 x1877914978245632/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919594 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919578.810418:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f28559ad80 x1877914978245760/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919594 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919578.810425:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f285598e00 x1877914978246016/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919594 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919578.810432:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f28559a300 x1877914978246144/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919594 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790919578.810616:0:3458:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790919578.810619:0:3458:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790919578.810621:0:3458:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790919578.811825:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919578.811842:0:3458:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:1.0:1790919578.811857:0:3458:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff95f3a6a46000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919578.811956:0:3458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e24380 x1877914978246400/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919578.812011:0:3460:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff95f3a6a46000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1790919578.812017:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978246016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919578.812033:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978245632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919578.812084:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978246400:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:2.0:1790919578.812274:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978245504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919578.812303:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3458:1877914978246144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919578.812317:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978244224:0@lo:400:kworker.0 00000100:00100000:0.0:1790919578.812343:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3460:1877914978245760:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1790919578.812947:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877914978246400 offset 0 length 520: 4 00000020:00080000:2.0:1790919578.814555:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff95f3a687b380) has no exports 00000020:01000000:3.0:1790919578.869909:0:14896:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3b6063300 - data ffff95f3bda4e5e8/ffff95f3b41b7c00 00000020:01000000:3.0:1790919578.870039:0:14896:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f398c1cd20 - data ffff95f3bd8e0798/ffff95f3b5885000 00000001:00000004:0.0:1790919578.891467:0:14896:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1790919579.008925:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919579.008934:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1790919579.008943:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790919579.011317:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919579.011323:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1790919579.011443:0:14896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919579.011446:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790919579.012436:0:8234:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790919579.012442:0:8234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1790919579.012454:0:8234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790919579.013844:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919579.013849:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1790919579.013868:0:14896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919579.013870:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790919579.016019:0:9495:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790919579.016027:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1790919579.016040:0:9495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:2.0:1790919579.038762:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919579.080646:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790919579.080655:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f2843f7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919579.080950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2843f7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790919579.081013:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f2843f1000 for lustre-OST0000 00000020:00000080:2.0:1790919579.126582:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591323f 00000020:00000080:2.0:1790919579.126594:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc035800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790919579.127318:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913254 00000020:00000080:2.0:1790919579.127325:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc033800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919579.127582:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc035800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1790919579.127694:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1790919579.127700:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919579.127708:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919579.127713:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff95f3a68799c0) has no exports 00000004:01000000:2.0:1790919579.127866:0:14896:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790919579.127874:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591355d 00000020:00000080:2.0:1790919579.127879:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f2862ed800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790919579.127883:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790919579.127886:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919579.127893:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919579.127896:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff95f3bbb68000) has no exports 00000020:00000080:2.0:1790919579.127900:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913556 00000020:00000080:2.0:1790919579.127903:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f2862ec000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790919579.127976:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc033800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1790919579.127983:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862ed800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790919579.127999:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862ec000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790919579.128416:0:14896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790919579.128425:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919579.128429:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1790919579.128435:0:14896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919579.128437:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919579.128509:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.128516:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919579.128521:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159133ff 00000020:00000080:2.0:1790919579.128526:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f284004000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919579.128821:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b64f2000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790919579.128828:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3b58c4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919579.128830:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1790919579.128835:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790919579.129016:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790919579.129020:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919579.129027:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919579.129030:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff95f3b42b4d40) has no exports 00000020:00000080:2.0:1790919579.129035:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159133f8 00000020:00000080:2.0:1790919579.129039:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f385581800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1790919579.129425:0:14896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790919579.129429:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919579.129432:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1790919579.129436:0:14896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919579.129437:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919579.129467:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.129472:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1790919579.129482:0:14896:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790919579.129486:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159132b6 00000020:00000080:2.0:1790919579.129490:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bb58a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790919579.129495:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1790919579.129498:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919579.129500:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919579.129502:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff95f3bce44d40) has no exports 00000020:00000080:2.0:1790919579.129506:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159132af 00000020:00000080:2.0:1790919579.129508:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc033000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790919579.130021:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284004000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790919579.130030:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f385581800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790919579.130035:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f385587000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790919579.130040:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3b6250800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919579.130042:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6250800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1790919579.130046:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790919579.130160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bb58a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790919579.130166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc033000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790919579.130703:0:14896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1790919579.130708:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919579.130720:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1790919579.130726:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919579.130772:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.130780:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919579.130805:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.130808:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919579.130811:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3ad8a4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790919579.130814:0:14896:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3ad8a4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1790919579.130819:0:14896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919579.130959:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591325b 00000020:00000080:2.0:1790919579.130965:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc034000/lustre-MDD0001_UUID 00000020:01000000:2.0:1790919579.130969:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1790919579.130973:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919579.130977:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919579.130980:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff95f3a687cd40) has no exports 00000020:00000080:2.0:1790919579.130997:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.131000:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1790919579.131003:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913262 00000020:00000080:2.0:1790919579.131006:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc034800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1790919579.131012:0:14896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3b4712800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1790919579.131015:0:14896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3b4712800 2 00000020:01000004:2.0:1790919579.131018:0:14896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f3b4712800 from lustre-MDT0001 00000020:00000080:2.0:1790919579.131033:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.131036:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1790919579.131038:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3bc031000/lustre-MDT0001_UUID 00000020:00000080:2.0:1790919579.131040:0:14896:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc031000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1790919579.131046:0:14896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:0.0:1790919579.131308:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3bc037800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790919579.131315:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3bb588800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919579.131317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bb588800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1790919579.131321:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000004:3.0:1790919579.131443:0:14896:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1790919579.131448:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1790919579.131451:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919579.131454:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790919579.131463:0:14896:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff95f3b4717000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919579.131468:0:14896:0:(genops.c:1552:class_disconnect_exports()) OBD device 15 (ffff95f3908a8000) has exports, disconnecting them 00000020:00080000:3.0:1790919579.131472:0:14896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff95f3b4717000), last request at 1790919370 00000020:00000080:3.0:1790919579.131475:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159132f5 00000020:00080000:3.0:1790919579.131486:0:14896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3b4717000): rc 0 00000020:00000080:3.0:1790919579.131499:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3b4717000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790919579.132261:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc034000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1790919579.132268:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3bc032800/lustre-MDD0001_UUID 00000020:00000080:0.0:1790919579.132270:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc032800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1790919579.132278:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1790919579.132478:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc034800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790919579.132483:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4717000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1790919579.144139:0:14896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1790919579.144149:0:14896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919579.144153:0:14896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919579.144161:0:14896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919579.144418:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919579.144427:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1790919579.144433:0:14896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3b4712800 1 00000020:00000080:2.0:1790919579.144440:0:14896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159131f2 00000020:00000080:2.0:1790919579.144447:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3b4711800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790919579.144476:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b600c800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790919579.144482:0:8:0:(genops.c:885:class_export_put()) final put ffff95f3b4711000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1790919579.144485:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4711000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1790919579.144496:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:2.0:1790919579.144858:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1790919579.144863:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919579.144868:0:14896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919579.144872:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff95f3908acd40) has no exports 00000020:00000080:0.0:1790919579.145461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4711800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790919579.156596:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919579.156611:0:14896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1790919579.156616:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f3b4710000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790919579.156620:0:14896:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4710000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1790919579.156629:0:14896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1790919579.156776:0:14896:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f3b4716800 00000020:01000000:3.0:1790919579.156816:0:14896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790919579.156820:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919579.156824:0:14896:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790919579.156828:0:14896:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff95f38d5819c0) has no exports 00000100:00100000:2.0:1790919579.156988:0:6445:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff95f38d595e00:6445] 0 exiting: rc = 1 00000100:00100000:2.0:1790919579.157109:0:7785:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff95f3b6603c00:7785] 3 exiting: rc = 0 00000100:00100000:2.0:1790919579.157174:0:6446:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff95f38d594200:6446] 1 exiting: rc = 0 00000100:00100000:2.0:1790919579.157228:0:10757:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff95f398d78a00:10757] 4 exiting: rc = 0 00000100:00100000:1.0:1790919579.157356:0:13325:0:(service.c:3206:ptlrpc_main()) mdt00_005: service thread [ffff95f398cf2c00:13325] 5 exiting: rc = 0 00000100:00100000:1.0:1790919579.157429:0:6447:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff95f38d594a00:6447] 2 exiting: rc = 0 00000100:00100000:3.0:1790919579.157610:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157617:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157623:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157629:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157635:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157641:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157646:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157651:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157656:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157661:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157670:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157675:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157681:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157687:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157693:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157698:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157704:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157714:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157744:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157751:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157756:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157761:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157766:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157783:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157788:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157792:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157797:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157802:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157807:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157812:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157827:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157848:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157854:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157858:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157863:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157868:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157873:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157878:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157883:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157888:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157893:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157897:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157902:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157907:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157966:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157972:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157977:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157982:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157986:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157991:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.157996:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158001:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158006:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158011:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158016:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158022:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158027:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158032:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158043:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158048:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158149:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158155:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158160:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.158165:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.161330:0:6449:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95f38d594600:6449] 1 exiting: rc = 0 00000100:00100000:3.0:1790919579.161415:0:6448:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95f39893ae00:6448] 0 exiting: rc = 1 00000100:00100000:2.0:1790919579.161479:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161486:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161492:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161497:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161503:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161508:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161567:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161573:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161578:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161584:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161591:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161597:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161602:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161607:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161612:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161617:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161621:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161626:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161631:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161637:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161642:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161660:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161665:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161670:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161675:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161680:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161686:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161691:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161696:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161701:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161706:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161712:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161717:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161721:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161727:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161732:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161737:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161742:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161747:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161752:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161757:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161762:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161767:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161772:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161777:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161782:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161787:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161792:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161797:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161803:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161808:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161813:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161818:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161824:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161829:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161833:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161848:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161852:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161857:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161861:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161865:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161870:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161874:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.161879:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.162391:0:6451:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff95f38d596800:6451] 1 exiting: rc = 0 00000100:00100000:3.0:1790919579.162587:0:7568:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff95f3b41e6600:7568] 2 exiting: rc = 0 00000100:00100000:1.0:1790919579.163300:0:6450:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff95f38d597200:6450] 0 exiting: rc = 1 00000100:00100000:2.0:1790919579.163619:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163628:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163634:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163641:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163649:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163667:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163705:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163711:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163716:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163722:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163730:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163737:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163742:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163748:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163753:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163762:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163768:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163787:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163794:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163800:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163806:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163812:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163817:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163822:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163828:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163834:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163848:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163859:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163865:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163885:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163893:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163899:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163904:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163910:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163977:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163984:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163989:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.163995:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164000:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164005:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164011:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164031:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164037:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164042:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164048:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164471:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164478:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164484:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164580:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164589:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164595:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164600:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164605:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164626:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164672:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164678:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164684:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164690:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164726:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164734:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164744:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164762:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164769:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919579.164786:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919579.177314:0:6452:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff95f38d597e00:6452] 0 exiting: rc = 1 00000100:00100000:1.0:1790919579.177447:0:6453:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95f38d596200:6453] 1 exiting: rc = 0 00000100:00100000:3.0:1790919579.177548:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177558:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177563:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177568:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177573:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177578:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177584:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177590:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177595:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177600:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177606:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177611:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177617:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177622:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177627:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177632:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177637:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177643:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177648:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177653:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177658:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177664:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177669:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177675:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177679:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177684:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177702:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177707:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177712:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177717:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177722:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177727:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177732:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177737:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177743:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177748:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177753:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177758:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177762:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177767:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177772:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177777:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177781:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177785:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177790:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177794:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177798:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177803:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177807:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177811:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177816:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177820:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177825:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177829:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177833:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177837:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177842:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177846:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177850:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177855:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177859:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177871:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177876:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.177881:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.178941:0:6454:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95f38d596e00:6454] 0 exiting: rc = 1 00000100:00100000:3.0:1790919579.179171:0:6455:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95f38d597a00:6455] 1 exiting: rc = 0 00000100:00100000:1.0:1790919579.179269:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179277:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179283:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179288:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179293:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179298:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179304:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179309:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179314:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179319:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179324:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179329:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179333:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179338:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179344:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179350:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179355:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179361:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179365:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179370:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179375:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179380:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179384:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179388:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179392:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179397:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179411:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179416:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179420:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179425:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179430:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179435:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179439:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179445:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179449:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179455:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179461:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179467:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179473:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179477:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179483:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179488:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179494:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179498:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179502:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179507:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179525:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179531:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179536:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179541:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179547:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179552:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179557:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179562:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179566:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179571:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179576:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179580:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179585:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179590:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179595:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179608:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179613:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.179618:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919579.180214:0:6457:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff95f38d597600:6457] 1 exiting: rc = 0 00000100:00100000:1.0:1790919579.180357:0:6456:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff95f38d596c00:6456] 0 exiting: rc = 1 00000100:00100000:1.0:1790919579.180403:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180409:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180414:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180419:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180424:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180430:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180435:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180440:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180445:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180450:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180456:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180461:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180466:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180470:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180475:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180480:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180485:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180490:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180495:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180499:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180504:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180508:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180525:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180531:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180536:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180541:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180546:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180551:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180557:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180562:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180567:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180581:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180586:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180592:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180597:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180602:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180607:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180612:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180617:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180622:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180627:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180631:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180636:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180641:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180646:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180650:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180656:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180661:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180666:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180672:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180677:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180682:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180686:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180691:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180696:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180700:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180705:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180709:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180715:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180720:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180725:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180731:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180736:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.180741:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919579.181633:0:6458:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff95f39885a400:6458] 0 exiting: rc = 1 00000100:00100000:1.0:1790919579.182027:0:6460:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff95f398843c00:6460] 2 exiting: rc = 0 00000100:00100000:3.0:1790919579.182395:0:6459:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff95f39885b000:6459] 1 exiting: rc = 0 00000100:00100000:1.0:1790919579.182592:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182607:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182613:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182618:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182624:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182629:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182636:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182642:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182647:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182653:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182658:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182664:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182672:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182678:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182683:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182688:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182693:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182698:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182704:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182710:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182733:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182740:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182745:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182751:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182756:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182762:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182767:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182773:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182779:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182785:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182791:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182796:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182801:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182807:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182813:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182819:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182831:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182836:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182841:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182846:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182852:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182857:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182862:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182867:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182884:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182889:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182895:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182899:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182905:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.182910:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183038:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183043:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183049:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183110:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183126:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183132:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183138:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183143:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183149:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183154:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183159:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183165:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183170:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919579.183183:0:14896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790919579.187691:0:14896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919579.187705:0:14896:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790919579.187710:0:14896:0:(genops.c:885:class_export_put()) final put ffff95f39a053800/MDS_uuid 00000020:00000080:1.0:1790919579.187715:0:14896:0:(genops.c:844:class_export_destroy()) destroying export ffff95f39a053800/MDS_uuid for MDS 00000020:01000000:1.0:1790919579.187721:0:14896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790919579.187842:0:14896:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00000001:00100000:2.0:1790919579.610261:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790919579.610271:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f3a6bab800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790919579.610331:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a6bab800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790919579.610381:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3a6bac000 for lustre-OST0001 00010000:00010000:1.0:1790919580.062072:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919581.084365:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790919581.799130:0:15049:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790919581.816889:0:15049:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790919581.816934:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919581.816949:0:15049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919581.816958:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919581.816964:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919581.816988:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790919581.816993:0:15049:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790919581.817015:0:15049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790919581.817019:0:15049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790919581.817025:0:15049:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790919581.817031:0:15049:0:(import.c:65:import_set_state_nolock()) ffff95f3b4715800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790919581.817035:0:15049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790919581.817037:0:15049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790919581.817040:0:15049:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790919581.817199:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919581.817206:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919581.817213:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919581.817217:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919581.817226:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919581.817233:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919581.817238:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919581.817240:0:6434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790919581.817243:0:6434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790919581.817256:0:6434:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:2.0:1790919581.817259:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919581.817265:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204b600/0x951c50ad1591362f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913636 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919581.817276:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919581.817277:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919581.817293:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919581.819440:0:15049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790919581.819447:0:15049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790919581.819455:0:15049:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790919581.819477:0:15049:0:(import.c:65:import_set_state_nolock()) ffff95f284001000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790919581.819523:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978246528:0@lo:39:umount.0 00000400:00000100:3.0:1790919581.819585:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978246528 offset 0 length 224: 4 00010000:00010000:1.0:1790919582.109644:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919582.621294:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919582.621378:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919582.621382:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919582.621387:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790919582.621394:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919582.621405:0:477:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 386 00000100:00080000:3.0:1790919582.621414:0:477:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790919582.621435:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f2862e9800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919582.621495:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fed80 x1877914978246656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919582.621589:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978246656:0@lo:38:kworker.0 00000400:00000100:2.0:1790919582.621668:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978246656 offset 0 length 520: 4 00000100:00100000:0.0:1790919582.622308:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978246784:0@lo:400:kworker.0 00000400:00000100:0.0:1790919582.622348:0:3460:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978246784 offset 0 length 224: 4 00010000:00010000:0.0:1790919583.132828:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919583.644287:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919583.644301:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919583.644305:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919583.644309:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790919583.644445:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919583.647377:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978246912:0@lo:400:kworker.0 00000400:00000100:0.0:1790919583.647468:0:3460:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978246912 offset 0 length 224: 4 00010000:00010000:2.0:1790919584.156516:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919585.181769:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919586.204344:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919587.228617:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919587.676374:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919587.676399:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919587.676402:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919587.676406:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790919587.676695:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919587.676718:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978247040:0@lo:400:kworker.0 00000400:00000100:0.0:1790919587.676771:0:3459:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978247040 offset 0 length 224: 4 00010000:00010000:1.0:1790919588.258030:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919588.765527:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919578/real 1790919578] req@ffff95f382e24380 x1877914978246400/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790919588 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919588.765561:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f382e24380 x1877914978246400/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790919588 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790919588.765583:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919588.765621:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1790919588.765625:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978246400:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1790919588.765909:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919588.765914:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790919588.765917:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919588.765921:0:477:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 387 00000100:00080000:3.0:1790919588.765926:0:477:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790919588.765936:0:477:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff95f3a6a46000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919588.765968:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fc000 x1877914978247168/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919588.765994:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919588.765999:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790919588.766186:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978247168:0@lo:250:kworker.0 00000400:00000100:2.0:1790919588.766229:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877914978247168 offset 0 length 520: 4 00000100:00100000:1.0:1790919588.766284:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919588.766296:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978247296:0@lo:400:kworker.0 00000400:00000100:1.0:1790919588.766323:0:3458:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978247296 offset 0 length 224: 4 00010000:00010000:0.0:1790919589.277607:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919590.300245:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919591.324305:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919591.836628:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919581/real 1790919581] req@ffff95f38d549880 x1877914978246528/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790919591 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919591.836668:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f38d549880 x1877914978246528/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790919591 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790919591.836694:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284001000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790919591.836713:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978246528:0@lo:39:umount.0 00000100:00080000:1.0:1790919591.837081:0:15049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790919591.837087:0:15049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790919591.837094:0:15049:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790919591.841751:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841776:0:15049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841784:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841792:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841830:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919591.841838:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841845:0:15049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841852:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919591.841859:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.841882:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919591.842996:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790919591.843009:0:15049:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1790919591.843010:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919591.843049:0:15049:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00010000:00010000:2.0:1790919591.843066:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919591.843072:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1790919591.843075:0:15049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790919591.843083:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919591.843090:0:15049:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790919591.843095:0:15049:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff95f3bdfe19c0) has no exports 00010000:00010000:2.0:1790919591.843097:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919591.843108:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919591.843114:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919591.843117:0:7708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790919591.843120:0:7708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:1.0:1790919591.843131:0:15049:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff95f3bdfe19c0) has no exports 00010000:00010000:2.0:1790919591.843141:0:7708:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:2.0:1790919591.843147:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.843153:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d000/0x951c50ad1591363d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913644 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.843171:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919591.843175:0:7708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.843181:0:7708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919591.843184:0:7708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.843192:0:7708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919591.843205:0:7708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919591.843210:0:7708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790919591.843213:0:7708:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790919591.843215:0:7708:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790919591.843221:0:7708:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:2.0:1790919591.843224:0:7708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.843231:0:7708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad159138b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159138ba expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919591.843242:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919591.843244:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919591.843247:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919591.843410:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790919591.846854:0:15049:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3b5a06180 - data ffff95f3a6eccd80/ffff95f284ee3800 00000020:01000000:1.0:1790919591.850858:0:15049:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f398ddd2a0 - data ffff95f3bda17288/ffff95f3aef7a000 00100000:10000000:2.0:1790919591.861831:0:15049:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790919591.903694:0:15049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913373 00000020:00000080:1.0:1790919591.903989:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f284000000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1790919591.904083:0:15049:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3be491000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1790919591.904089:0:15049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3be491000 2 00000020:01000004:1.0:1790919591.904094:0:15049:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f3be491000 from lustre-OST0000 00000020:00000080:1.0:1790919591.904175:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919591.904294:0:15049:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1790919591.904298:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f3b6256000/lustre-OST0000_UUID 00000020:00000080:1.0:1790919591.904302:0:15049:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6256000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1790919591.904311:0:15049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790919591.904500:0:15049:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790919591.904507:0:15049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790919591.905010:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919591.905018:0:15049:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790919591.905036:0:15049:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95f3bc16b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919591.905044:0:15049:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff95f3b42b3380) has exports, disconnecting them 00000020:00080000:0.0:1790919591.905050:0:15049:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95f3bc16b000), last request at 1790919384 00000020:00000080:0.0:1790919591.905498:0:15049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591339d 00000020:00080000:0.0:1790919591.905522:0:15049:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3bc16b000): rc 0 00000020:00000080:0.0:1790919591.905529:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f3bc16b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790919591.905587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284000000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:1.0:1790919591.910116:0:15049:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790919591.910128:0:15049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790919591.910134:0:15049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790919591.910144:0:15049:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790919591.911706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bc16b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790919591.911733:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b4715800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790919591.911958:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919591.911976:0:15049:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790919591.911984:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f3b6250000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790919591.911988:0:15049:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6250000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790919591.911994:0:15049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790919591.912695:0:15049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790919591.912703:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919591.912711:0:15049:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790919591.912720:0:15049:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff95f284005800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790919591.912727:0:15049:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff95f3bdfe3380) has exports, disconnecting them 00000020:00080000:1.0:1790919591.912733:0:15049:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff95f284005800), last request at 1790919384 00000020:00000080:1.0:1790919591.912738:0:15049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159133b2 00000020:00080000:1.0:1790919591.912760:0:15049:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f284005800): rc 0 00000020:00000080:1.0:1790919591.912764:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f284005800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1790919591.912856:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284005800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1790919591.919141:0:15049:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790919591.919239:0:15049:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790919591.919246:0:15049:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919591.919262:0:15049:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790919591.919588:0:477:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f284001000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790919591.919682:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919591.919702:0:15049:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1790919591.919712:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f284001800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1790919591.919717:0:15049:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284001800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1790919591.919731:0:15049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1790919591.919815:0:15049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3be491000 1 00000020:00000080:2.0:1790919591.919824:0:15049:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591333b 00000020:00000080:2.0:1790919591.919832:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f398c69800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790919591.919858:0:15049:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790919591.919864:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919591.919873:0:15049:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919591.919878:0:15049:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff95f3b42b19c0) has no exports 00000020:00000080:3.0:1790919591.921393:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f398c69800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790919591.956087:0:15049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919591.956109:0:15049:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790919591.956117:0:15049:0:(genops.c:885:class_export_put()) final put ffff95f3ad8a4000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790919591.956124:0:15049:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3ad8a4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790919591.956138:0:15049:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790919591.956356:0:15049:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f3be495800 00000020:02000400:1.0:1790919591.956409:0:15049:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1790919592.349507:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919593.374081:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919593.884330:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790919593.884344:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919593.884347:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790919593.884350:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790919593.884513:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978247424:0@lo:400:kworker.0 00000400:00000100:2.0:1790919593.884586:0:3460:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978247424 offset 0 length 224: 4 00010000:00010000:1.0:1790919594.399435:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790919594.498927:0:15201:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790919594.507612:0:15201:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790919594.507708:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919594.507746:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919594.507752:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919594.507759:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919594.507780:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790919594.507787:0:15201:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790919594.507819:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919594.507836:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f2860fed80 x1877914978246656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919594.507856:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790919594.507862:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919594.507869:0:15201:0:(import.c:65:import_set_state_nolock()) ffff95f2862e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790919594.507875:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919594.507878:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f2860fed80 x1877914978246656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919602 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919594.507885:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790919594.507888:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1790919594.507945:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978246656:0@lo:38:kworker.0 00010000:00010000:0.0:1790919594.508211:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919594.508225:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919594.508237:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3c204b000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919594.508242:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919594.508254:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919594.508262:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919594.508269:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919594.508272:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790919594.508277:0:6433:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790919594.508294:0:6433:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:0.0:1790919594.508298:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919594.508307:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3c204b000/0x951c50ad15913613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad1591361a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919594.508322:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919594.508340:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919594.508343:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919594.512966:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790919594.512990:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f2860fce00 x1877914978246784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919594.513124:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f2860fe300 x1877914978246912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919599 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919594.513134:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f2860fdf80 x1877914978247040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919603 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919594.513151:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f2860ffb80 x1877914978247296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919604 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919594.513168:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f28559ad80 x1877914978247424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919609 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919594.513209:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790919594.513216:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790919594.513250:0:15201:0:(import.c:65:import_set_state_nolock()) ffff95f2862ea000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790919594.513311:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978247040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919594.513470:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978246784:0@lo:400:kworker.0 00000100:00100000:3.0:1790919594.513493:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978247296:0@lo:400:kworker.0 00000100:00100000:0.0:1790919594.513495:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978247424:0@lo:400:kworker.0 00000100:00100000:0.0:1790919594.513505:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978246912:0@lo:400:kworker.0 00000100:00100000:3.0:1790919594.513630:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978247552:0@lo:39:umount.0 00000400:00000100:3.0:1790919594.513708:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978247552 offset 0 length 224: 4 00010000:00010000:0.0:1790919595.420828:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919596.444669:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919597.469131:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919598.492300:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919599.004360:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919599.004372:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1790919599.516653:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919600.540750:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919601.564818:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919602.593453:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919603.613119:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919603.741107:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919588/real 1790919588] req@ffff95f2860fc000 x1877914978247168/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790919603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919603.741151:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f2860fc000 x1877914978247168/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790919603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790919603.741175:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919603.741205:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1790919603.741209:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978247168:0@lo:250:kworker.0 00000100:00080000:0.0:1790919603.741322:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790919603.741329:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790919603.741332:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919603.741338:0:477:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1790919603.741345:0:477:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790919603.741359:0:477:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff95f3a6a46000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919603.741402:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f28559ad80 x1877914978247680/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919603.741693:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978247680:0@lo:250:kworker.0 00000400:00000100:3.0:1790919603.741764:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877914978247680 offset 0 length 520: 4 00010000:00010000:1.0:1790919604.636432:0:7708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919604.764478:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919594/real 1790919594] req@ffff95f38d54b480 x1877914978247552/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790919604 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919604.764523:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f38d54b480 x1877914978247552/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790919604 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790919604.764550:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2862ea000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790919604.764576:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978247552:0@lo:39:umount.0 00000100:00080000:1.0:1790919604.764770:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790919604.764776:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790919604.764782:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790919604.765838:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765859:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765867:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765875:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765908:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919604.765918:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765963:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765971:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.765978:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919604.766163:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790919604.766168:0:15201:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790919604.766194:0:15201:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790919604.766200:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790919604.766206:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919604.766213:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790919604.766219:0:15201:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff95f3bbfd99c0) has no exports 00000020:00080000:1.0:1790919604.766254:0:15201:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff95f3bbfd99c0) has no exports 00000020:01000000:1.0:1790919604.768857:0:15201:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f284c06ea0 - data ffff95f3bdaf1e58/ffff95f3b626ec00 00010000:00010000:0.0:1790919604.768965:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919604.768978:0:6433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919604.768991:0:6433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919604.769000:0:6433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919604.769013:0:6433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919604.769026:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919604.769036:0:6434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919604.769068:0:6433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919604.769076:0:6433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919604.769079:0:6434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1ce00 already unused, calling callback (ffffffffc1a99c20) 10000000:01000000:0.0:1790919604.769081:0:6433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790919604.769086:0:6433:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:00010000:3.0:1790919604.769093:0:6434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919604.769103:0:6434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919604.769108:0:6433:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 10000000:00010000:3.0:1790919604.769111:0:6434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919604.769114:0:6433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919604.769128:0:6434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919604.769130:0:6433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15913621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913628 expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919604.769133:0:6434:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790919604.769138:0:6434:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790919604.769149:0:6434:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:3.0:1790919604.769153:0:6434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919604.769160:0:6434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159138a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159138ac expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1790919604.769167:0:15201:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3b43965a0 - data ffff95f283dba5e8/ffff95f3b6595800 00010000:00010000:3.0:1790919604.769188:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919604.769193:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919604.769196:0:6434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919604.769220:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919604.769221:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919604.769223:0:6433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790919604.780047:0:15201:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790919604.812474:0:15201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159134b5 00000020:00000080:3.0:1790919604.812487:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f3b58c5000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790919604.812510:0:15201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3a6ada000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790919604.812515:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3a6ada000 2 00000020:01000004:3.0:1790919604.812519:0:15201:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f3a6ada000 from lustre-OST0001 00000020:00000080:3.0:1790919604.812557:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919604.812578:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790919604.812582:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f3b58c4800/lustre-OST0001_UUID 00000020:00000080:3.0:1790919604.812586:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790919604.812595:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790919604.812770:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1948390b-ad58-4044-9ddd-8f90f3aaa52f->MGS 00010000:00010000:3.0:1790919604.812791:0:15201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f380030a00/0x951c50ad1591320e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919604.812805:0:15201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f380030a00/0x951c50ad1591320e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919604.812813:0:15201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790919604.812816:0:15201:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790919604.812820:0:15201:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790919604.812837:0:15201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:3.0:1790919604.812842:0:15201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f380030a00/0x951c50ad1591320e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15913215 expref: -99 pid: 7234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919604.812860:0:15201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919604.812867:0:15201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919604.812873:0:15201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790919604.812875:0:15201:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790919604.812877:0:15201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790919604.812888:0:15201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3a6a46000 00010000:00010000:3.0:1790919604.812891:0:15201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6487400/0x951c50ad15913683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad1591368a expref: -99 pid: 6443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790919604.812911:0:15201:0:(import.c:65:import_set_state_nolock()) ffff95f3a6a46000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790919604.812915:0:15201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790919604.812918:0:15201:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790919604.812920:0:15201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790919604.812925:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790919604.812953:0:15201:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f28559ad80 x1877914978247680/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790919623 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790919604.812970:0:15201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790919604.812973:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:2.0:1790919604.813212:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1948390b-ad58-4044-9ddd-8f90f3aaa52f:3457:1877914978247680:0@lo:250:kworker.0 10000000:01000000:2.0:1790919604.813269:0:15201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790919604.813279:0:15201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591310b 00000020:00000080:2.0:1790919604.813286:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f387e35800/1948390b-ad58-4044-9ddd-8f90f3aaa52f 00000020:01000000:2.0:1790919604.813294:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.111@tcp (flags='') 00000020:00000080:2.0:1790919604.813300:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919604.813307:0:15201:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919604.813312:0:15201:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff95f3908ab380) has no exports 00000020:00000080:0.0:1790919604.813605:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790919604.813618:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f387e35800/1948390b-ad58-4044-9ddd-8f90f3aaa52f for MGC192.168.203.111@tcp 10000000:01000000:3.0:1790919604.814871:0:6443:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790919604.814880:0:15201:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.111@tcp: client import never connected 00000100:00080000:2.0:1790919604.814886:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790919604.814891:0:15201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790919604.814895:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790919604.814899:0:15201:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790919604.815360:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919604.815373:0:15201:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.111@tcp (uuid 1948390b-ad58-4044-9ddd-8f90f3aaa52f) 00000020:01000000:2.0:1790919604.815382:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790919604.815387:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919604.815394:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790919604.815404:0:15201:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95f2862eb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1790919604.815406:0:477:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3a6a46000 for MGC192.168.203.111@tcp 00000020:00080000:2.0:1790919604.815415:0:15201:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff95f3bbfdb380) has exports, disconnecting them 00000020:00000080:0.0:1790919604.815418:0:477:0:(genops.c:885:class_export_put()) final put ffff95f3a6a42800/1948390b-ad58-4044-9ddd-8f90f3aaa52f 00000020:00080000:2.0:1790919604.815422:0:15201:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95f2862eb000), last request at 1790919400 00000020:00000080:0.0:1790919604.815492:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a6a42800/1948390b-ad58-4044-9ddd-8f90f3aaa52f for MGC192.168.203.111@tcp 00000020:01000000:0.0:1790919604.815500:0:477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.111@tcp (1948390b-ad58-4044-9ddd-8f90f3aaa52f) 00000020:00000080:2.0:1790919604.816126:0:15201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159134df 00000020:00080000:2.0:1790919604.816161:0:15201:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f2862eb000): rc 0 00000020:00000080:2.0:1790919604.816168:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f2862eb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790919604.816263:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862eb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1790919604.819178:0:15201:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790919604.819190:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919604.819196:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790919604.819206:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790919604.819690:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919604.819823:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1790919604.819833:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790919604.819838:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919604.819844:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790919604.819854:0:15201:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff95f2862e8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919604.819862:0:15201:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff95f3bbfdcd40) has exports, disconnecting them 00000020:00080000:3.0:1790919604.819868:0:15201:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff95f2862e8000), last request at 1790919400 00000020:00000080:3.0:1790919604.819873:0:15201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159134f4 00000020:00080000:3.0:1790919604.819895:0:15201:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f2862e8000): rc 0 00000020:00000080:3.0:1790919604.819901:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f2862e8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1790919604.820244:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f2862e9800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790919604.820253:0:8:0:(genops.c:885:class_export_put()) final put ffff95f3b58c1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1790919604.820256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1790919604.820264:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1790919604.820418:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862e8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1790919604.823149:0:15201:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790919604.823166:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790919604.823171:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790919604.823180:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919604.823216:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f2862ea000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1790919604.823849:0:7708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1790919604.826217:0:6434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790919604.826405:0:6433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1790919604.826522:0:6429:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95f38d47be00:6429] 1 exiting: rc = 0 00000100:00100000:0.0:1790919604.826870:0:6428:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95f38714d800:6428] 0 exiting: rc = 1 00000100:00100000:0.0:1790919604.826963:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.827684:0:6430:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95f38d47ac00:6430] 0 exiting: rc = 1 00000100:00100000:1.0:1790919604.829049:0:6431:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95f38d47b600:6431] 1 exiting: rc = 0 00000100:00100000:2.0:1790919604.831323:0:6432:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95f38d47a600:6432] 2 exiting: rc = 0 00000100:00100000:2.0:1790919604.831564:0:12731:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_004: service thread [ffff95f3be2ee800:12731] 4 exiting: rc = 0 00000100:00100000:2.0:1790919604.831644:0:7709:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff95f3b646e000:7709] 3 exiting: rc = 0 00000100:00100000:2.0:1790919604.831729:0:13233:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_005: service thread [ffff95f3bbc8c600:13233] 5 exiting: rc = 0 00000100:00100000:0.0:1790919604.831828:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831850:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831862:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831869:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831876:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831883:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831895:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831902:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831913:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831921:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831936:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831947:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831954:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831963:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831974:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831981:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.831988:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832000:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832008:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832018:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832047:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832079:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832086:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832092:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832098:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832105:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832111:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832118:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832124:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832130:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832138:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832150:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832156:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832163:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832169:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832179:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832185:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832190:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832199:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832206:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832212:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832222:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832228:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832238:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832245:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832251:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832256:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832266:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832272:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832282:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832288:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832295:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832303:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832310:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832316:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832349:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832355:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832365:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832372:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832379:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832389:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832395:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832401:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.832411:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790919604.834988:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919604.835004:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1790919604.835013:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f2862ef800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1790919604.835018:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862ef800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1790919604.835026:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1790919604.835111:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3a6ada000 1 00000020:00000080:0.0:1790919604.835119:0:15201:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15913484 00000020:00000080:0.0:1790919604.835127:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f3b6103800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1790919604.835141:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1790919604.835156:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6103800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790919604.835170:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919604.835176:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790919604.835180:0:15201:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff95f3a68b99c0) has no exports 00000020:00000080:0.0:1790919604.891923:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919604.894806:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1790919604.894815:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f3a6adf800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1790919604.894821:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3a6adf800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1790919604.894843:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1790919604.895110:0:15201:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f3a6adf000 00000020:01000000:0.0:1790919604.895140:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1790919604.895146:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919604.895151:0:15201:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790919604.895157:0:15201:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff95f3bdfe0000) has no exports 00000020:00000080:0.0:1790919604.895202:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919604.895210:0:15201:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1790919604.895214:0:15201:0:(genops.c:885:class_export_put()) final put ffff95f398c6f800/OSS_uuid 00000020:00000080:0.0:1790919604.895216:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff95f398c6f800/OSS_uuid for OSS 00000020:01000000:0.0:1790919604.895220:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790919604.895514:0:8083:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff95f3be251400:8083] 1 exiting: rc = 0 00000100:00100000:2.0:1790919604.895628:0:8084:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff95f3be250000:8084] 2 exiting: rc = 0 00000100:00100000:2.0:1790919604.895692:0:8082:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff95f382f2cc00:8082] 0 exiting: rc = 1 00000100:00100000:0.0:1790919604.896025:0:8248:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff95f3bbc96e00:8248] 3 exiting: rc = 0 00000100:00100000:0.0:1790919604.896149:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896159:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896166:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896174:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896183:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896188:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896194:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896200:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896207:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896214:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896222:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896229:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896235:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896241:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896247:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896253:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896260:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896267:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896272:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896277:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896282:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896288:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896294:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896301:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896307:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896314:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896320:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896335:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896342:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896361:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896366:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896372:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896377:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896383:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896388:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896393:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896399:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896405:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896411:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896417:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896547:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896554:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896630:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896652:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896660:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896666:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896673:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896679:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896684:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896690:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896961:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896971:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896976:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896982:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896988:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.896995:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897002:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897008:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897017:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897023:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897028:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897034:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897040:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.897045:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1790919604.898402:0:6441:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790919604.900138:0:8565:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff95f2810e3e00:8565] 2 exiting: rc = 0 00000100:00100000:2.0:1790919604.902034:0:8086:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95f38648b200:8086] 0 exiting: rc = 1 00000100:00100000:3.0:1790919604.902043:0:8087:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95f382f4ee00:8087] 1 exiting: rc = 0 00000100:00100000:0.0:1790919604.903274:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903290:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903298:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903304:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903310:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903315:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903321:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903394:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903401:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903407:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903414:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903486:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903495:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903500:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903505:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903510:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903516:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903521:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903526:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903532:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903538:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903543:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903549:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903555:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903560:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903567:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903642:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903649:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903655:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903661:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903666:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903673:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903678:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903684:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903773:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903779:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903784:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903790:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903795:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903801:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903807:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903812:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903819:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903825:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903831:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903836:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903842:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903905:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903915:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903921:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903936:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903943:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903948:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903954:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903960:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903966:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903972:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903978:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903984:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903989:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.903996:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.904002:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.904007:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.904013:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.906329:0:8089:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95f398856000:8089] 1 exiting: rc = 0 00000100:00100000:1.0:1790919604.906596:0:8088:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95f3ae93ce00:8088] 0 exiting: rc = 1 00000100:00100000:3.0:1790919604.907089:0:8090:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95f3b646ea00:8090] 2 exiting: rc = 0 00000100:00100000:2.0:1790919604.909360:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909380:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909388:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909394:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909400:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909406:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909412:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909418:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909424:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909430:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909437:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909444:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909450:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909456:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909462:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909468:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909474:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909480:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909487:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909493:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909499:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909505:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909511:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909533:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909539:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909545:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909567:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909574:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909580:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909586:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909591:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909599:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909606:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909613:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909620:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909626:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909631:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909638:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909644:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909650:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909655:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909661:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909669:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909675:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909681:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909687:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909693:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909699:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909705:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909712:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909719:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909725:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909731:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909738:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909744:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909750:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909764:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909771:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909783:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909789:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909796:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909808:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909824:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919604.909831:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.923395:0:8092:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95f383fb6a00:8092] 1 exiting: rc = 0 00000100:00100000:0.0:1790919604.923418:0:8091:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95f3922b7200:8091] 0 exiting: rc = 1 00000100:00100000:3.0:1790919604.927142:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927153:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927159:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927165:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927171:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927176:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927194:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927199:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927204:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927210:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927215:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927220:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927226:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927231:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927237:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927242:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927247:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927253:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927258:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927263:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927269:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927274:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927279:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927284:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927289:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927294:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927299:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927304:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927310:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927315:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927320:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927324:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927329:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927334:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927339:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927344:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927366:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927373:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927379:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927384:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927389:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927402:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927408:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927414:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927420:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927426:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927431:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927436:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927441:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927446:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927450:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.927455:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928246:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928257:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928261:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928265:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928270:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928275:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928280:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928284:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928289:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928293:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928298:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.928302:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919604.931471:0:8093:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff95f383fb7400:8093] 0 exiting: rc = 1 00000100:00100000:1.0:1790919604.934614:0:8094:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95f3aeb07800:8094] 1 exiting: rc = 0 00000100:00100000:3.0:1790919604.935486:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935510:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935527:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935534:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935540:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935545:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935553:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935558:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935564:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935569:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935575:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935579:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935603:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935610:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935706:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935716:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935727:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935736:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935746:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935753:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935759:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935767:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935773:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935779:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935786:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935791:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935816:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935823:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935829:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935836:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935841:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935847:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935853:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935858:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935863:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935869:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935874:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935880:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935979:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935988:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.935994:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936000:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936011:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936017:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936026:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936033:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936038:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936068:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936075:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936085:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936093:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936100:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936114:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936138:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936150:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936157:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936164:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936175:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936185:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936197:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936206:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936212:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936217:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919604.936223:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790919604.946366:0:15201:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790919622.766344:0:15924:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790919630.447038:0:16388:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790919630.447045:0:16388:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790919630.447187:0:16388:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f3aee80800 00000020:01000004:2.0:1790919630.447203:0:16388:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790919630.447211:0:16388:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790919630.447225:0:16388:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95f3a68b8000) 00000020:00000080:2.0:1790919630.447238:0:16388:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790919630.478472:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790919630.481462:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790919630.481985:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 549: rc = 0 00100000:10000000:2.0:1790919630.482217:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 549: rc = 0 00100000:10000000:2.0:1790919630.482360:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:2.0:1790919630.482456:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 549: rc = 0 00100000:10000000:2.0:1790919630.482551:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:2.0:1790919630.482819:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790919630.482952:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 549: rc = 0 00100000:10000000:2.0:1790919630.483047:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 549: rc = 0 00100000:10000000:2.0:1790919630.483322:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 641: rc = 0 00100000:10000000:2.0:1790919630.484727:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 556: rc = 0 00100000:10000000:2.0:1790919630.484837:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 556: rc = 0 00100000:10000000:2.0:1790919630.485291:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 779: rc = 0 00100000:10000000:2.0:1790919630.485679:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919630.486024:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919630.486363:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 779: rc = 0 00100000:10000000:2.0:1790919630.486608:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919630.487016:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 779: rc = 0 00100000:10000000:2.0:1790919630.487288:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 779: rc = 0 00100000:10000000:2.0:1790919630.487525:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919630.487851:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 779: rc = 0 00100000:10000000:2.0:1790919630.488229:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919630.488509:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 779: rc = 0 00100000:10000000:2.0:1790919630.488821:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919630.489552:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 288: rc = 0 00100000:10000000:2.0:1790919630.489964:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 288: rc = 0 00100000:10000000:2.0:1790919630.490270:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 288: rc = 0 00100000:10000000:2.0:1790919630.490506:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 288: rc = 0 00100000:10000000:2.0:1790919630.490826:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 288: rc = 0 00100000:10000000:2.0:1790919630.491190:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 288: rc = 0 00100000:10000000:2.0:1790919630.491435:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 288: rc = 0 00100000:10000000:2.0:1790919630.491758:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 288: rc = 0 00100000:10000000:2.0:1790919630.492250:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 288: rc = 0 00100000:10000000:2.0:1790919630.492514:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 288: rc = 0 00100000:10000000:2.0:1790919630.492857:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 288: rc = 0 00100000:10000000:2.0:1790919630.493207:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 288: rc = 0 00100000:10000000:2.0:1790919630.493442:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 288: rc = 0 00100000:10000000:2.0:1790919630.493789:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 288: rc = 0 00100000:10000000:2.0:1790919630.494205:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 288: rc = 0 00100000:10000000:2.0:1790919630.494454:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 288: rc = 0 00100000:10000000:2.0:1790919630.494771:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 288: rc = 0 00100000:10000000:2.0:1790919630.495143:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 288: rc = 0 00100000:10000000:2.0:1790919630.495951:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 288: rc = 0 00100000:10000000:2.0:1790919630.496286:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 288: rc = 0 00100000:10000000:2.0:1790919630.496779:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 288: rc = 0 00100000:10000000:2.0:1790919630.497032:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 288: rc = 0 00100000:10000000:2.0:1790919630.497303:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 288: rc = 0 00100000:10000000:2.0:1790919630.497554:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 288: rc = 0 00100000:10000000:2.0:1790919630.497822:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 288: rc = 0 00100000:10000000:2.0:1790919630.498137:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 288: rc = 0 00100000:10000000:2.0:1790919630.498369:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 288: rc = 0 00100000:10000000:2.0:1790919630.498610:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 288: rc = 0 00100000:10000000:2.0:1790919630.498867:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 288: rc = 0 00100000:10000000:2.0:1790919630.499163:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 288: rc = 0 00100000:10000000:2.0:1790919630.499410:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 288: rc = 0 00100000:10000000:2.0:1790919630.499651:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 288: rc = 0 00100000:10000000:2.0:1790919630.502190:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 277: rc = 0 00100000:10000000:2.0:1790919630.502381:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 277: rc = 0 00100000:10000000:2.0:1790919630.502975:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790919630.503229:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 557: rc = 0 00100000:10000000:2.0:1790919630.503407:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790919630.503469:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 557: rc = 0 00100000:10000000:2.0:1790919630.503723:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790919630.503801:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 557: rc = 0 00100000:10000000:2.0:1790919630.504220:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790919630.504288:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 272: rc = 0 00100000:10000000:2.0:1790919630.504480:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790919630.504547:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 272: rc = 0 00100000:10000000:2.0:1790919630.504809:0:16388:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790919630.504873:0:16388:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 272: rc = 0 00000020:00000080:2.0:1790919630.505204:0:16388:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790919630.505211:0:16388:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790919630.505220:0:16388:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914666 00000020:01000004:2.0:1790919630.505227:0:16388:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790919630.505231:0:16388:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790919630.505236:0:16388:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3aee80800 from MGS 00000020:01000004:2.0:1790919630.505239:0:16388:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790919630.505248:0:16388:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff95f3a68bb380) 00000020:00000080:2.0:1790919630.505257:0:16388:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790919630.505303:0:16388:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3aee80800 from MGS, refs=2 00080000:01000000:2.0:1790919630.505307:0:16388:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919630.505310:0:16388:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914674 00000100:00100000:2.0:1790919630.505397:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790919630.505523:0:16388:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790919630.505528:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790919630.506220:0:16388:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790919630.506227:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790919630.506890:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919630.507034:0:16388:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790919630.507038:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790919630.507456:0:16388:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790919630.507463:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790919630.507780:0:16388:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790919630.507787:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790919630.508290:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919630.508294:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919630.508295:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919630.508575:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919630.508577:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919630.508579:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919630.509105:0:16388:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790919630.512814:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790919630.518841:0:16388:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790919630.518858:0:16388:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790919630.518861:0:16388:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790919630.520437:0:16397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790919630.520577:0:16388:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790919630.520684:0:16388:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790919630.521184:0:16388:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790919630.521460:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919630.521638:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790919630.521643:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790919630.523422:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790919630.523431:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790919630.527707:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790919630.527718:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790919630.528291:0:16388:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790919630.528310:0:16388:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:2.0:1790919630.528316:0:16388:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790919630.528342:0:16388:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:2.0:1790919630.528354:0:16388:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (ffff95f3a68bcd40) 00000020:00000080:2.0:1790919630.528368:0:16388:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790919630.528433:0:16388:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3be491000@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919630.528577:0:16388:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:2.0:1790919630.528583:0:16388:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790919630.528715:0:16402:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790919630.529111:0:16403:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790919630.529166:0:16388:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid fb00aa6a-67be-455f-87d9-71f2084f0f0a) 00000020:00000080:1.0:1790919630.529181:0:16388:0:(genops.c:1384:class_connect()) connect: client fb00aa6a-67be-455f-87d9-71f2084f0f0a, cookie 0x951c50ad15914682 00000100:00080000:1.0:1790919630.529189:0:16388:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919630.529196:0:16388:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff95f3be491000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919630.529225:0:16388:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f38d548380 x1877914978247808/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919630.529248:0:16388:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fb00aa6a-67be-455f-87d9-71f2084f0f0a->MGS 00000020:01000004:1.0:1790919630.529264:0:16388:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790919630.529268:0:16388:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790919630.529277:0:16388:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95f3bbb6b380) 00000020:00000080:1.0:1790919630.529285:0:16388:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790919630.529375:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3457:1877914978247808:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790919630.529432:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.530693:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978247808 00000100:00100000:3.0:1790919630.530705:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978247808 00000100:00100000:3.0:1790919630.530749:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919630.530757:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3457:x1877914978247808:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790919630.530782:0:16398:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from fb00aa6a-67be-455f-87d9-71f2084f0f0a@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1790919630.530806:0:16398:0:(genops.c:1384:class_connect()) connect: client fb00aa6a-67be-455f-87d9-71f2084f0f0a, cookie 0x951c50ad15914690 00000100:00080000:3.0:1790919630.530931:0:16398:0:(import.c:65:import_set_state_nolock()) ffff95f287071000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919630.531023:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+5:3457:x1877914978247808:12345-0@lo:250:mount.lustre.0 Request processed in 264us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919630.531040:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919630.531102:0:3457:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790919630.531110:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1790919630.531116:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790919630.531119:0:3457:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790919630.531122:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3be491000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790919630.531124:0:3457:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790919630.531130:0:3457:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790919630.531134:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3457:1877914978247808:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790919630.541981:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919630.542256:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790919630.542262:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790919630.547709:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790919630.547722:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790919630.549246:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790919630.549257:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790919630.550364:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919630.550552:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790919630.550558:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790919630.551137:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790919630.551144:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790919630.586167:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919630.586377:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790919630.586383:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790919630.587448:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790919630.587459:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790919630.588198:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919630.588362:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790919630.588369:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790919630.588923:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790919630.588930:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790919630.592407:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919630.592586:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790919630.592593:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790919630.593186:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790919630.593193:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790919630.593752:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919630.593888:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790919630.593892:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790919630.594385:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790919630.594392:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790919630.611469:0:16388:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790919630.611790:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790919630.611797:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790919630.612953:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790919630.612963:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790919630.613721:0:16388:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790919630.613729:0:16388:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790919630.614510:0:16388:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790919630.614533:0:16388:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790919630.614539:0:16388:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790919630.614752:0:16388:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790919630.614787:0:16388:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790919630.614792:0:16388:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790919630.614793:0:16388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790919630.614795:0:16388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919630.614796:0:16388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919630.614798:0:16388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919630.614799:0:16388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919630.614800:0:16388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919630.614802:0:16388:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790919630.614804:0:16388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919630.614805:0:16388:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790919630.614808:0:16388:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790919630.614810:0:16388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790919630.614811:0:16388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790919630.614812:0:16388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919630.614813:0:16388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919630.614814:0:16388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919630.614815:0:16388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919630.614816:0:16388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919630.614822:0:16388:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790919630.614823:0:16388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919630.614824:0:16388:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790919630.614849:0:16388:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790919630.614867:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978247936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790919630.614980:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.615088:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3919920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.615318:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978247936 00000100:00100000:1.0:1790919630.615326:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978247936 00000100:00100000:1.0:1790919630.615398:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919630.615407:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+5:16388:x1877914978247936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919630.615453:0:16401:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790919630.615456:0:16401:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790919630.615459:0:16401:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790919630.615806:0:16422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790919630.616150:0:16401:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1790919630.617321:0:16423:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790919630.617326:0:16423:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790919630.617329:0:16423:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790919630.617332:0:16423:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790919630.617470:0:16423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1790919630.617795:0:16401:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790919630.617805:0:16401:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790919630.644106:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+5:16388:x1877914978247936:12345-0@lo:253:mount.lustre.0 Request processed in 28691us (29118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.644126:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919630.644229:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978247936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790919630.644244:0:16388:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790919630.644247:0:16388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919630.644249:0:16388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790919630.644250:0:16388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919630.644251:0:16388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919630.644253:0:16388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919630.644254:0:16388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919630.644255:0:16388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919630.644257:0:16388:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790919630.644259:0:16388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919630.644260:0:16388:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790919630.644284:0:16388:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3aee80800 from lustre-MDT0000 10000000:01000000:0.0:1790919630.644309:0:16388:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790919630.644312:0:16388:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790919630.644316:0:16388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95f3a68bcd40 10000000:01000000:0.0:1790919630.644320:0:16388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919630.644328:0:16388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f3a68bcd40 from 1 10000000:01000000:0.0:1790919630.644331:0:16388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790919630.644368:0:16388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.644378:0:16388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.644405:0:16388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.644693:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919630.644815:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.644892:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.644927:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248064 00000100:00100000:2.0:1790919630.644934:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248064 00000100:00100000:2.0:1790919630.647354:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919630.647377:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+5:16388:x1877914978248064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919630.647396:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919630.647418:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860efa00/0x951c50ad1591469e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914697 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.647445:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860efa00/0x951c50ad1591469e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914697 expref: 6 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.647456:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860efa00/0x951c50ad1591469e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914697 expref: 6 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.647484:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860efa00, rc 0) 00000100:00100000:2.0:1790919630.647561:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+6:16388:x1877914978248064:12345-0@lo:101:mount.lustre.0 Request processed in 194us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.647568:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919630.647611:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919630.647635:0:16388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.647644:0:16388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.647713:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919630.647761:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.647798:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.647817:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248192 00000100:00100000:1.0:1790919630.647823:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248192 00000100:00100000:1.0:1790919630.647865:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919630.647872:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+6:16388:x1877914978248192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919630.648122:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+6:16388:x1877914978248192:12345-0@lo:501:mount.lustre.0 Request processed in 250us (359us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919630.648129:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919630.648359:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248192:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790919630.648384:0:16388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790919630.648407:0:16388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.648588:0:16388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919630.648596:0:16388:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3aee80800 10000000:01000000:0.0:1790919630.648601:0:16388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919630.648613:0:16388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95f3aee80800 10000000:01000000:0.0:1790919630.648616:0:16388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790919630.648663:0:16388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95f3aee80800 from 1 10000000:01000000:0.0:1790919630.648666:0:16388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790919630.648687:0:16388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.648694:0:16388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.648703:0:16388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.648717:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919630.648812:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.648840:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.648886:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248320 00000100:00100000:2.0:1790919630.648891:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248320 00000100:00100000:2.0:1790919630.648958:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919630.648965:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+6:16388:x1877914978248320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919630.648974:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919630.648985:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860efe00/0x951c50ad159146ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159146a5 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.648998:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860efe00/0x951c50ad159146ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159146a5 expref: 7 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.649006:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860efe00/0x951c50ad159146ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159146a5 expref: 7 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.649012:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860efe00, rc 0) 00000100:00100000:2.0:1790919630.649045:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+7:16388:x1877914978248320:12345-0@lo:101:mount.lustre.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.649087:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919630.649142:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919630.649153:0:16388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.649161:0:16388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919630.649173:0:16388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790919630.649182:0:16388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.649189:0:16388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919630.649205:0:16388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790919630.649218:0:16388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919630.649223:0:16388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95f3aee80800 10000000:01000000:0.0:1790919630.649225:0:16388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790919630.649228:0:16388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790919630.649230:0:16388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790919630.649244:0:16388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.649251:0:16388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.649258:0:16388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.649270:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919630.649295:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.651040:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.651182:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248448 00000100:00100000:1.0:1790919630.651189:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248448 00000100:00100000:1.0:1790919630.651242:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919630.651250:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+7:16388:x1877914978248448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919630.651263:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919630.651279:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1d000/0x951c50ad159146ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159146b3 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.651300:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d000/0x951c50ad159146ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159146b3 expref: 8 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.651310:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1d000/0x951c50ad159146ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159146b3 expref: 8 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.651317:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d000, rc 0) 00000100:00100000:1.0:1790919630.651375:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+8:16388:x1877914978248448:12345-0@lo:101:mount.lustre.0 Request processed in 126us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919630.651381:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919630.651582:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919630.651597:0:16388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.651605:0:16388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.651674:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919630.651705:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.651809:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.651851:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248576 00000100:00100000:1.0:1790919630.651855:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248576 00000100:00100000:1.0:1790919630.651871:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919630.651877:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+8:16388:x1877914978248576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919630.652455:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16388:x1877914978248576:12345-0@lo:501:mount.lustre.0 Request processed in 575us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919630.652464:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919630.652665:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919630.652702:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919630.653000:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.653032:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.653093:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248704 00000100:00100000:2.0:1790919630.653099:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248704 00000100:00100000:2.0:1790919630.653136:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919630.653144:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16388:x1877914978248704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919630.653430:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16388:x1877914978248704:12345-0@lo:503:mount.lustre.0 Request processed in 287us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.653443:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919630.653876:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978248704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919630.654406:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16424:1877914978248832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919630.654464:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.655303:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248832 00000100:00100000:3.0:1790919630.655312:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248832 00000100:00100000:3.0:1790919630.655365:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919630.655374:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16424:x1877914978248832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919630.655857:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39270a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919630.656405:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16424:x1877914978248832:12345-0@lo:502:llog_process_th.0 Request processed in 1030us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919630.656415:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919630.656545:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16424:1877914978248832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790919630.656582:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919630.656595:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919630.656597:0:16424:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790919630.656601:0:16424:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790919630.656604:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919630.656681:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95f3bbb6cd40) 00000020:00000080:1.0:1790919630.656701:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790919630.656710:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790919630.656891:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790919630.656898:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad159146c8 00000020:00000080:1.0:1790919630.657154:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790919630.657158:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919630.657161:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919630.657163:0:16424:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790919630.657165:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919630.657168:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919630.657170:0:16424:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790919630.657173:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790919630.657181:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95f3bbb68000) 00000020:00000080:1.0:1790919630.657190:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790919630.657194:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790919630.657196:0:16424:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790919630.657199:0:16424:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790919630.657205:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790919630.657246:0:16424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3aee80800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790919630.657258:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95f3bbb699c0) 00000020:00000080:1.0:1790919630.657265:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790919630.657307:0:16424:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790919630.657312:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad159146dd 00000020:00000080:1.0:1790919630.657554:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790919630.657561:0:16424:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790919630.657565:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x951c50ad159146e4 00080000:01000000:1.0:1790919630.657578:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790919630.657581:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad159146eb 00010000:00010000:3.0:1790919630.753586:0:16424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790919630.757297:0:16424:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1790919630.757545:0:16424:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790919630.758335:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95f3bce40000) 00000020:00000080:3.0:1790919630.758355:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790919630.758417:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790919630.758424:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad159146f9 00000020:00000080:2.0:1790919630.763011:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790919630.773494:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x951c50ad15914700 00000020:00000080:2.0:1790919630.773789:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790919630.773804:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919630.773810:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.773812:0:16424:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790919630.773817:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790919630.773819:0:16424:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1790919630.773821:0:16424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919630.773822:0:16424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919630.773824:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790919630.773827:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.773829:0:16424:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790919630.773833:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919630.773839:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.773840:0:16424:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790919630.773846:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790919630.773884:0:16424:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790919630.773902:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919630.773905:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.773907:0:16424:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790919630.773911:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919630.773914:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.773915:0:16424:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1790919630.773918:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790919630.773924:0:16424:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:2.0:1790919630.773956:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919630.773973:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff95f3a68b99c0) 00000020:00000080:2.0:1790919630.773991:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790919630.773996:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790919630.774089:0:16424:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1790919630.774095:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790919630.774102:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad1591470e 00010000:00080000:2.0:1790919630.774137:0:16424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3b5a26800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919630.775898:0:16424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1790919630.777876:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919630.777890:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790919630.777920:0:16424:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790919630.777937:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15914715 00000100:00080000:3.0:1790919630.777947:0:16424:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919630.777964:0:16424:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f3b5a26800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919630.778001:0:16424:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fc000 x1877914978248960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919630.778031:0:16424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1790919630.778117:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.778121:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.778123:0:16424:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1790919630.778126:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790919630.778128:0:16424:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1790919630.778130:0:16424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919630.778131:0:16424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919630.778133:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790919630.778135:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.778136:0:16424:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790919630.778139:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790919630.778144:0:16424:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790919630.778147:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.778148:0:16424:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790919630.778150:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919630.778154:0:16424:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1790919630.778175:0:16424:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790919630.778178:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919630.778191:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95f3bce419c0) 00000020:00000080:3.0:1790919630.778201:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790919630.778205:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919630.778255:0:16424:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790919630.778261:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790919630.778267:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914723 00010000:00080000:3.0:1790919630.778299:0:16424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3b58c0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919630.778513:0:16424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1790919630.778897:0:16424:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790919630.778947:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1790919630.779196:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978248960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790919630.779271:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.779383:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978248960 00000100:00100000:0.0:1790919630.779392:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978248960 00000100:00100000:0.0:1790919630.779429:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919630.779437:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978248960:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1790919630.779453:0:16411:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:3.0:1790919630.782047:0:16424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919630.782221:0:16424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1790919630.782284:0:16424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1790919630.782788:0:16430:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790919630.782794:0:16430:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790919630.783564:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919630.783580:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790919630.783633:0:16424:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790919630.783654:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591472a 00000100:00080000:2.0:1790919630.783664:0:16424:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919630.783675:0:16424:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f3b58c0000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919630.783896:0:16424:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e26300 x1877914978249088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919630.783961:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978249088:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790919630.784012:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978249088 offset 0 length 520: 4 00000100:00080000:2.0:1790919630.784111:0:16424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790919630.784200:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919630.784205:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.784207:0:16424:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790919630.784210:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790919630.784213:0:16424:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1790919630.784215:0:16424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919630.784216:0:16424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919630.784218:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790919630.784220:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.784221:0:16424:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790919630.784223:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790919630.784227:0:16424:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790919630.784231:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919630.784232:0:16424:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790919630.784236:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790919630.784255:0:16424:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1790919630.784276:0:16424:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790919630.784279:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919630.784291:0:16424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95f3bdfe0000) 00000020:00000080:2.0:1790919630.784302:0:16424:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1790919630.784307:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790919630.784359:0:16424:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790919630.784364:0:16424:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790919630.784368:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914738 00010000:00080000:2.0:1790919630.784387:0:16424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f383f4b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919630.784951:0:16424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790919630.785172:0:16424:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790919630.785193:0:16424:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790919630.786037:0:16424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919630.786126:0:16424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790919630.786213:0:16424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790919630.786886:0:16432:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919630.786891:0:16432:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790919630.788753:0:16424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919630.788772:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790919630.788817:0:16424:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790919630.788839:0:16424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591473f 00000100:00080000:3.0:1790919630.788849:0:16424:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919630.788858:0:16424:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f383f4b800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919630.788894:0:16424:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860ffb80 x1877914978249216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919630.788928:0:16424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790919630.788986:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.788991:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.788992:0:16424:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790919630.788995:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919630.788998:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.789000:0:16424:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790919630.789002:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790919630.789004:0:16424:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790919630.789006:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.789008:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.789009:0:16424:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790919630.789011:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919630.789013:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.789024:0:16424:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790919630.789029:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790919630.789263:0:16424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16424:1877914978249344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919630.789339:0:16424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.789371:0:16424:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.790256:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978249344 00000100:00100000:2.0:1790919630.790265:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978249344 00000100:00100000:2.0:1790919630.790318:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919630.790328:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16424:x1877914978249344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919630.790586:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16424:x1877914978249344:12345-0@lo:502:llog_process_th.0 Request processed in 259us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.790593:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919630.790679:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978249216:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790919630.790689:0:16424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16424:1877914978249344:0@lo:502:llog_process_th.0 00000400:00000100:1.0:1790919630.790712:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978249216 offset 0 length 520: 4 00000020:01000000:3.0:1790919630.790734:0:16424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.790750:0:16424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.790752:0:16424:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790919630.790757:0:16424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790919630.791048:0:16388:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790919630.791091:0:16388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790919630.791112:0:16388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.791124:0:16388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919630.791138:0:16388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3aee80800 from 1 10000000:01000000:2.0:1790919630.791140:0:16388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919630.791167:0:16388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.791174:0:16388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.791194:0:16388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919630.791211:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919630.791243:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919630.791264:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b62726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919630.791318:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978249472 00000100:00100000:3.0:1790919630.791323:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978249472 00000100:00100000:3.0:1790919630.791353:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919630.791360:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+9:16388:x1877914978249472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919630.791369:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919630.791381:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914746 expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.791401:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914746 expref: 10 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.791411:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914746 expref: 10 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.791420:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c800, rc 0) 00000100:00100000:3.0:1790919630.791456:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+10:16388:x1877914978249472:12345-0@lo:101:mount.lustre.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919630.791462:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919630.791574:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919630.791586:0:16388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.791595:0:16388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919630.792566:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249600:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790919630.792693:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919630.792778:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b62726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919630.792864:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978249600 00000100:00100000:3.0:1790919630.792875:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978249600 00000100:00100000:3.0:1790919630.792951:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919630.792960:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+10:16388:x1877914978249600:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790919630.792976:0:16400:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790919630.792981:0:16400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790919630.793047:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+10:16388:x1877914978249600:12345-0@lo:256:mount.lustre.0 Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919630.793073:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919630.793142:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249600:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790919630.793667:0:16388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919630.793693:0:16388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.793703:0:16388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919630.793719:0:16388:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3aee80800 from 1 10000000:01000000:2.0:1790919630.793722:0:16388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919630.793755:0:16388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.793763:0:16388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.793771:0:16388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919630.793785:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919630.793818:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919630.793847:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b62726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919630.794080:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978249728 00000100:00100000:3.0:1790919630.794086:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978249728 00000100:00100000:3.0:1790919630.794114:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919630.794122:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+10:16388:x1877914978249728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919630.794132:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919630.794144:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914754 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.794164:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914754 expref: 11 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.794175:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914754 expref: 11 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.794295:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d800, rc 0) 00000100:00100000:3.0:1790919630.794371:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978249728:12345-0@lo:101:mount.lustre.0 Request processed in 249us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919630.794379:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919630.794436:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919630.794449:0:16388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.794457:0:16388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919630.794505:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919630.794531:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919630.794565:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b62726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.794758:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978249856 00000100:00100000:1.0:1790919630.794763:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978249856 00000100:00100000:1.0:1790919630.794796:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919630.794804:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978249856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919630.795254:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978249856:12345-0@lo:501:mount.lustre.0 Request processed in 451us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919630.795263:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919630.796362:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919630.796414:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919630.796478:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.796513:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.796559:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978249984 00000100:00100000:2.0:1790919630.796565:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978249984 00000100:00100000:2.0:1790919630.796601:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919630.796677:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978249984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919630.796925:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978249984:12345-0@lo:503:mount.lustre.0 Request processed in 317us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.796933:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919630.797087:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978249984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919630.797517:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16434:1877914978250112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919630.797554:0:16434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.797618:0:16434:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.797698:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250112 00000100:00100000:2.0:1790919630.797703:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250112 00000100:00100000:2.0:1790919630.797803:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919630.797810:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16434:x1877914978250112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919630.798120:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16434:x1877914978250112:12345-0@lo:502:llog_process_th.0 Request processed in 309us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.798127:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919630.798298:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16434:1877914978250112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919630.798324:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919630.798332:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798334:0:16434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790919630.798341:0:16434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3aee80800 00000020:00000080:3.0:1790919630.798344:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919630.798351:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.798354:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798355:0:16434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790919630.798358:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919630.798360:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798362:0:16434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790919630.798365:0:16434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3aee80800 00000020:00000080:3.0:1790919630.798367:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919630.798425:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.798429:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798430:0:16434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790919630.798432:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919630.798435:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798436:0:16434:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919630.798439:0:16434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3aee80800 00000020:00000080:3.0:1790919630.798441:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919630.798459:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.798462:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798468:0:16434:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919630.798472:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919630.798475:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.798476:0:16434:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790919630.798479:0:16434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3aee80800 00000020:00000080:3.0:1790919630.798481:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790919630.798516:0:16434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16434:1877914978250240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790919630.798551:0:16434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.798607:0:16434:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.798889:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250240 00000100:00100000:2.0:1790919630.798894:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250240 00000100:00100000:2.0:1790919630.798957:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919630.798964:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16434:x1877914978250240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919630.799127:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16434:x1877914978250240:12345-0@lo:502:llog_process_th.0 Request processed in 163us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.799134:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790919630.800981:0:16434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16434:1877914978250240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919630.801023:0:16434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919630.801031:0:16434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919630.801033:0:16434:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790919630.801038:0:16434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790919630.802378:0:16388:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790919630.802411:0:16388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919630.802430:0:16388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.802442:0:16388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919630.802484:0:16388:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919630.802486:0:16388:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3aee80800 10000000:01000000:3.0:1790919630.802489:0:16388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3aee80800 10000000:01000000:3.0:1790919630.802493:0:16388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919630.802497:0:16388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3aee80800 from 1 10000000:01000000:3.0:1790919630.802500:0:16388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919630.802532:0:16388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.802549:0:16388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.802559:0:16388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919630.802579:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978250368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919630.802632:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.802672:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.802770:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250368 00000100:00100000:2.0:1790919630.802777:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250368 00000100:00100000:2.0:1790919630.802826:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919630.802835:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978250368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919630.802847:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919630.802863:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ef000/0x951c50ad15914769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914762 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.802884:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ef000/0x951c50ad15914769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914762 expref: 12 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.802895:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ef000/0x951c50ad15914769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914762 expref: 12 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919630.802903:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef000, rc 0) 00000100:00100000:2.0:1790919630.802936:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16388:x1877914978250368:12345-0@lo:101:mount.lustre.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.802943:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919630.803016:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978250368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919630.803029:0:16388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.803038:0:16388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919630.803107:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978250496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919630.803131:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.803146:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.803195:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250496 00000100:00100000:2.0:1790919630.803199:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250496 00000100:00100000:2.0:1790919630.803254:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919630.803262:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16388:x1877914978250496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919630.803483:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16388:x1877914978250496:12345-0@lo:501:mount.lustre.0 Request processed in 222us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.803490:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919630.803542:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978250496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919630.803567:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978250624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919630.803600:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.803613:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919630.803626:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250624 00000100:00100000:3.0:1790919630.803630:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250624 00000100:00100000:3.0:1790919630.803663:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919630.803678:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16388:x1877914978250624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919630.803853:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16388:x1877914978250624:12345-0@lo:503:mount.lustre.0 Request processed in 177us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919630.803861:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919630.803903:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978250624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919630.808684:0:16436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16436:1877914978250752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919630.808770:0:16436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919630.808821:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250752 00000100:00100000:1.0:1790919630.808828:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250752 00000100:00100000:1.0:1790919630.808892:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919630.808921:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16436:x1877914978250752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919630.809257:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16436:x1877914978250752:12345-0@lo:502:llog_process_th.0 Request processed in 356us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919630.809265:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919630.809333:0:16436:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.809353:0:16436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16436:1877914978250752:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790919630.809415:0:16436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790919630.809430:0:16436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff95f38d5819c0) 00000020:00000080:1.0:1790919630.809454:0:16436:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1790919630.809535:0:16436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3aee80800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790919630.809539:0:16436:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3aee80800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790919630.809542:0:16436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3aee80800 4 00010000:00080000:1.0:1790919630.809583:0:16436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f284be7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919630.811501:0:16436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000100:00100000:0.0:1790919630.817820:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978248960:12345-0@lo:38:llog_process_th.0 Request processed in 38371us (38537us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790919630.817838:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790919630.817954:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919630.817966:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790919630.817971:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978248960:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1790919630.818492:0:16436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790919630.818545:0:16436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790919630.818561:0:16436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x951c50ad15914777 00000100:00080000:0.0:1790919630.818570:0:16436:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919630.818581:0:16436:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95f284be7000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919630.818629:0:16436:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f28559aa00 x1877914978250880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919630.818668:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978250880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919630.818756:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790919630.818808:0:16436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790919630.819453:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978250880 00000100:00100000:3.0:1790919630.819466:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978250880 00000100:00100000:3.0:1790919630.819516:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919630.819528:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978250880:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790919630.819624:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978250880:12345-0@lo:38:llog_process_th.0 Request processed in 97us (867us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790919630.819632:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919630.819688:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919630.819697:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284be7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919630.819703:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790919630.819707:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978250880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919630.820812:0:16436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16436:1877914978251008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919630.821331:0:16436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.821390:0:16436:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992000 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.821656:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251008 00000100:00100000:2.0:1790919630.821667:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251008 00000100:00100000:2.0:1790919630.821729:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919630.821756:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16436:x1877914978251008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919630.822873:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16436:x1877914978251008:12345-0@lo:502:llog_process_th.0 Request processed in 1116us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919630.822889:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919630.823504:0:16436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16436:1877914978251008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919630.823918:0:16436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16436:1877914978251136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919630.824002:0:16436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.824093:0:16436:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919630.824099:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251136 00000100:00100000:1.0:1790919630.824113:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251136 00000100:00100000:1.0:1790919630.824170:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919630.824180:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16436:x1877914978251136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919630.824560:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16436:x1877914978251136:12345-0@lo:502:llog_process_th.0 Request processed in 381us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919630.824571:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919630.826331:0:16436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16436:1877914978251136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790919630.826389:0:16436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790919630.829441:0:16388:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790919630.829482:0:16388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790919630.829500:0:16388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919630.829514:0:16388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790919630.829581:0:16388:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790919630.829583:0:16388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919630.829585:0:16388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919630.829591:0:16388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919630.829593:0:16388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919630.829594:0:16388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919630.829595:0:16388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919630.829597:0:16388:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919630.829598:0:16388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919630.829600:0:16388:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790919630.829603:0:16388:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790919630.829605:0:16388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919630.829606:0:16388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919630.829607:0:16388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919630.829609:0:16388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919630.829609:0:16388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919630.829610:0:16388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919630.829611:0:16388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919630.829612:0:16388:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919630.829613:0:16388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919630.829614:0:16388:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790919630.829644:0:16388:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790919630.829665:0:16388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978251264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790919630.829863:0:16388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919630.829898:0:16388:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919630.830669:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251264 00000100:00100000:2.0:1790919630.830695:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251264 00000100:00100000:2.0:1790919630.830777:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919630.830791:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16388:x1877914978251264:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790919630.830837:0:16398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790919630.830854:0:16398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790919630.917967:0:16398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790919630.917998:0:16398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790919630.918117:0:16422:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790919630.918128:0:16422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790919630.918158:0:16422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.918178:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914746 expref: 12 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.918338:0:16422:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.918384:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914746 expref: 12 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919630.918400:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914746 expref: 12 pid: 16398 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919630.918414:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978251392:0@lo:104: 00000100:00100000:1.0:1790919630.918490:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919630.918542:0:16422:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919630.919255:0:16389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251392 00000100:00100000:0.0:1790919630.919271:0:16389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251392 00000100:00100000:0.0:1790919630.919349:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919630.919362:0:16389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978251392:12345-0@lo:104: 00010000:00010000:0.0:1790919630.919385:0:16389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919494:0:16389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919630.919501:0:16389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978251392:12345-0@lo:104: Request processed in 143us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919630.919509:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790919630.919538:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919630.919546:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919570:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919630.919576:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919585:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919630.919592:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919630.919598:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919630.919639:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919645:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919630.919668:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919674:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ee800/0x951c50ad15914746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591474d expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919695:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919630.919697:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919630.919699:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919630.919728:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919630.919758:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978251520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919630.919800:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919630.919877:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251520 00000100:00100000:0.0:1790919630.919882:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251520 00010000:00010000:0.0:1790919630.919909:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914746 expref: 13 pid: 16398 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.919936:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919630.919943:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+13:3460:x1877914978251520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919630.919956:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919630.919962:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914746 expref: 13 pid: 16398 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919973:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914746 expref: 13 pid: 16398 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.919995:0:16391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920004:0:16391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919630.920487:0:16391:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002359236s 00010000:00010000:0.0:1790919630.920495:0:16391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920504:0:16391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920512:0:16391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920520:0:16391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920526:0:16391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919630.920539:0:16391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920549:0:16391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920560:0:16391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920573:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919630.920619:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+13:3460:x1877914978251520:12345-0@lo:103:ldlm_bl.0 Request processed in 675us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919630.920627:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919630.920676:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978251520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919630.920720:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166c800/0x951c50ad1591474d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914746 expref: 12 pid: 16398 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919630.920758:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978251392:0@lo:104: 00010000:00010000:0.0:1790919630.920775:0:16422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920784:0:16422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920791:0:16422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919630.920797:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1d800/0x951c50ad1591477e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919630.946509:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16388:x1877914978251264:12345-0@lo:253:mount.lustre.0 Request processed in 115708us (116631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919630.946528:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790919630.947232:0:16388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16388:1877914978251264:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790919630.947256:0:16388:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790919630.947260:0:16388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790919630.947262:0:16388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919630.947263:0:16388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919630.947265:0:16388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919630.947266:0:16388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919630.947268:0:16388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919630.947269:0:16388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919630.947271:0:16388:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919630.947273:0:16388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919630.947275:0:16388:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790919630.947317:0:16388:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919630.963867:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919630.965111:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919630.965514:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919630.965681:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919630.966441:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919630.966704:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919630.969832:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919630.970222:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919630.970692:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919630.970971:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919630.972952:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919630.973186:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1790919631.011693:0:16388:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1790919631.012407:0:16388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1790919631.012816:0:16448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1790919631.012912:0:16448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1790919631.015271:0:16388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1790919631.016513:0:16449:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff95f2860fed80 x1877914978251648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919631.016540:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00000020:00080000:1.0:1790919631.019422:0:16447:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790919631.019432:0:16447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1790919631.019855:0:16448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790919631.019954:0:16448:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1790919631.021499:0:16388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790919631.021715:0:16388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790919631.025873:0:16388:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790919631.025909:0:16388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790919631.026401:0:16388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919631.028813:0:16388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790919631.029786:0:16388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790919631.029852:0:16388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790919631.030678:0:16388:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1790919631.031664:0:16388:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1790919631.036353:0:16388:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790919631.076822:0:16388:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790919631.076882:0:16388:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa204c17bf988 00100000:10000000:1.0:1790919631.076894:0:16388:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790919631.078044:0:16388:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790919631.078101:0:16388:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790919631.078122:0:16388:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790919631.078203:0:16388:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1790919631.516267:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919631.836474:0:16440:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790919631.837074:0:16440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919631.838961:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1790919631.838974:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1790919631.964185:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919631.964194:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3aee80800 from 7 10000000:01000000:2.0:1790919631.964199:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919631.964246:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.964258:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.964289:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919631.964315:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978251776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919631.964388:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919631.964429:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e47d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919631.964450:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251776 00000100:00100000:2.0:1790919631.964457:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251776 00000100:00100000:2.0:1790919631.964502:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919631.964511:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+11:16403:x1877914978251776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919631.964523:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919631.964536:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914785 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.964557:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914785 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.964568:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914785 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.964576:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef600, rc 0) 00000100:00100000:2.0:1790919631.964615:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16403:x1877914978251776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919631.964622:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919631.964666:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978251776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919631.964680:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.964694:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919631.964752:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978251904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919631.964781:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919631.964796:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e47d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919631.964809:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251904 00000100:00100000:2.0:1790919631.964813:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251904 00000100:00100000:2.0:1790919631.964833:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919631.964838:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16403:x1877914978251904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790919631.964851:0:16398:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790919631.964865:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790919631.964868:0:16398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1790919631.964939:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:16403:x1877914978251904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919631.964946:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919631.964980:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978251904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790919631.965015:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919631.965022:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919631.965029:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919632.028648:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:1.0:1790919632.540223:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919632.867004:0:16440:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790919632.867014:0:16440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919632.867928:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1790919632.867996:0:16440:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790919632.868026:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:2.0:1790919633.055839:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:1.0:1790919633.564331:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919634.076611:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:3.0:1790919634.591049:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919634.730282:0:16692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790919635.101273:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:1.0:1790919635.614734:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919635.868171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790919635.868178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790919635.868182:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919635.868190:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1790919635.868195:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790919635.868206:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f3b5a26800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919635.868238:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f28559b100 x1877914978252160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919635.868255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919635.868259:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919635.868262:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919635.868264:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919635.868274:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790919635.868277:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790919635.868279:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f284be7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919635.868286:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95f284be7000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919635.868299:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285599880 x1877914978252288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919635.868347:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919635.868360:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978252032:0@lo:400:kworker.0 00000100:00100000:0.0:1790919635.868424:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919635.868481:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252160:0@lo:38:kworker.0 00000100:00100000:0.0:1790919635.868561:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919635.868591:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978252288:0@lo:38:kworker.0 00000100:00100000:0.0:1790919635.868615:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919635.868652:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978252032 00000100:00100000:0.0:1790919635.868658:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978252032 00000100:00100000:0.0:1790919635.868695:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919635.868716:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:3459:x1877914978252032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919635.868747:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978252160 00000100:00100000:3.0:1790919635.868752:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978252160 00000100:00100000:0.0:1790919635.868764:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:3459:x1877914978252032:12345-0@lo:400:kworker.0 Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919635.868771:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919635.868771:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790919635.868775:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978252160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790919635.868790:0:16412:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790919635.868808:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978252288 00000100:00100000:0.0:1790919635.868811:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978252288 00000100:00100000:0.0:1790919635.868828:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919635.868832:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978252288:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790919635.868847:0:16408:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1790919635.868886:0:16408:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x951c50ad15914793 00000004:00100000:0.0:1790919635.868901:0:16408:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919635.869027:0:16408:0:(import.c:65:import_set_state_nolock()) ffff95f3922a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919635.869087:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1877914978252288:12345-0@lo:38:kworker.0 Request processed in 253us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919635.869094:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919635.869129:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978252032:0@lo:400:kworker.0 00010000:00080000:0.0:1790919635.869163:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f285599880 x1877914978252288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790919635.869175:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790919635.869182:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790919635.869186:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919635.869188:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284be7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919635.869193:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978252288:0@lo:38:kworker.0 00000100:00100000:3.0:1790919635.883562:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978252160:12345-0@lo:38:kworker.0 Request processed in 14777us (14993us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919635.883576:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790919635.884000:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919635.884006:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790919635.884010:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252160:0@lo:38:kworker.0 00000100:00100000:3.0:1790919636.141465:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:3.0:1790919636.638776:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919637.148259:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:0.0:1790919637.661272:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919638.172439:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:3.0:1790919638.685837:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919639.196133:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:0.0:1790919639.708787:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919640.227048:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:3.0:1790919640.732812:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919640.981651:0:17041:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790919640.981655:0:17041:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:0.0:1790919640.981786:0:17041:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f391982800 00000020:01000004:0.0:1790919640.981802:0:17041:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1790919640.981816:0:17041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790919640.981831:0:17041:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff95f3b42b4d40) 00000020:00000080:0.0:1790919640.981847:0:17041:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00000100:00080000:3.0:1790919640.990942:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790919640.990949:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790919640.990952:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919640.990960:0:477:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:3.0:1790919640.990972:0:477:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790919640.990982:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f3b5a26800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919640.991002:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fd500 x1877914978252544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919640.991023:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919640.991027:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919640.991030:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919640.991033:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790919640.991077:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919640.991090:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978252416:0@lo:400:kworker.0 00000100:00100000:3.0:1790919640.991149:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919640.991192:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978252672:0@lo:400:kworker.0 00000100:00100000:3.0:1790919640.991226:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919640.991257:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978252416 00000100:00100000:3.0:1790919640.991264:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978252416 00000100:00100000:3.0:1790919640.991302:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919640.991310:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:3458:x1877914978252416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919640.991348:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:3458:x1877914978252416:12345-0@lo:400:kworker.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919640.991355:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919640.991385:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978252672 00000100:00100000:3.0:1790919640.991388:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978252672 00000100:00100000:3.0:1790919640.991406:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919640.991411:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978252672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919640.991439:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978252672:12345-0@lo:400:kworker.0 Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919640.991450:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919640.991478:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978252416:0@lo:400:kworker.0 00010000:00080000:3.0:1790919640.991501:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f2860fc000 x1877914978252672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919640.991511:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978252672:0@lo:400:kworker.0 00000100:00100000:3.0:1790919640.992234:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919630/real 1790919630] req@ffff95f2860ffb80 x1877914978249216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919640.992254:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f2860ffb80 x1877914978249216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919640.992263:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919630/real 1790919630] req@ffff95f382e26300 x1877914978249088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919640.992274:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f382e26300 x1877914978249088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919640.992286:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252544:0@lo:38:kworker.0 00000100:00100000:3.0:1790919640.992325:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919640.992453:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919640.992474:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790919640.992479:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978249216:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790919640.992483:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919640.992489:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790919640.992492:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978249088:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1790919640.992551:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978252544 00000100:00100000:1.0:1790919640.992557:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978252544 00000100:00080000:2.0:1790919640.993078:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919640.993082:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790919640.993085:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919640.993089:0:477:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1790919640.993094:0:477:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919640.993102:0:477:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f3b58c0000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919640.993126:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e26680 x1877914978252800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919640.993144:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919640.993147:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790919640.993149:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919640.993152:0:477:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1790919640.993155:0:477:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919640.993159:0:477:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f383f4b800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919640.993169:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e26d80 x1877914978252928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919640.993200:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252800:0@lo:8:kworker.0 00000400:00000100:2.0:1790919640.993229:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978252800 offset 0 length 520: 4 00000100:00100000:2.0:1790919640.993252:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252928:0@lo:8:kworker.0 00000400:00000100:2.0:1790919640.993283:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978252928 offset 0 length 520: 4 00000100:00100000:1.0:1790919640.994322:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919640.994331:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978252544:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790919640.994349:0:16411:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00100000:10000000:0.0:1790919641.000892:0:17041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790919641.001251:0:17041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790919641.002800:0:17041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1790919641.003230:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 419: rc = 0 00100000:10000000:0.0:1790919641.003326:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 419: rc = 0 00100000:10000000:0.0:1790919641.003429:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 419: rc = 0 00100000:10000000:0.0:1790919641.006853:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 47: rc = 0 00100000:10000000:0.0:1790919641.008587:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 47: rc = 0 00100000:10000000:0.0:1790919641.008867:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 47: rc = 0 00100000:10000000:0.0:1790919641.010324:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 47: rc = 0 00100000:10000000:0.0:1790919641.010611:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 47: rc = 0 00100000:10000000:0.0:1790919641.010876:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 47: rc = 0 00000100:00100000:1.0:1790919641.011561:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978252544:12345-0@lo:38:kworker.0 Request processed in 17225us (19230us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790919641.011579:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790919641.011683:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919641.011694:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919641.011698:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252544:0@lo:38:kworker.0 00100000:10000000:0.0:1790919641.012681:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 47: rc = 0 00100000:10000000:0.0:1790919641.012945:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 47: rc = 0 00100000:10000000:0.0:1790919641.013385:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 47: rc = 0 00100000:10000000:0.0:1790919641.013627:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 47: rc = 0 00100000:10000000:0.0:1790919641.013877:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 47: rc = 0 00100000:10000000:1.0:1790919641.014737:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 47: rc = 0 00100000:10000000:1.0:1790919641.017551:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 68: rc = 0 00100000:10000000:1.0:1790919641.017848:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 68: rc = 0 00100000:10000000:1.0:1790919641.018398:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 68: rc = 0 00100000:10000000:1.0:1790919641.019533:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 68: rc = 0 00100000:10000000:1.0:1790919641.019803:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 68: rc = 0 00100000:10000000:1.0:1790919641.020282:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 68: rc = 0 00100000:10000000:1.0:1790919641.020523:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 68: rc = 0 00100000:10000000:1.0:1790919641.020766:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 68: rc = 0 00100000:10000000:1.0:1790919641.021000:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 68: rc = 0 00100000:10000000:1.0:1790919641.021500:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 68: rc = 0 00100000:10000000:1.0:1790919641.021753:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 68: rc = 0 00100000:10000000:1.0:1790919641.022966:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 68: rc = 0 00100000:10000000:1.0:1790919641.023699:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 68: rc = 0 00100000:10000000:1.0:1790919641.023967:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 68: rc = 0 00100000:10000000:1.0:1790919641.024373:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 68: rc = 0 00100000:10000000:1.0:1790919641.024604:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 68: rc = 0 00100000:10000000:1.0:1790919641.024863:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 68: rc = 0 00100000:10000000:1.0:1790919641.025371:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 68: rc = 0 00100000:10000000:1.0:1790919641.025607:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 68: rc = 0 00100000:10000000:1.0:1790919641.026714:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 68: rc = 0 00100000:10000000:1.0:1790919641.026965:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 68: rc = 0 00100000:10000000:1.0:1790919641.027413:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 68: rc = 0 00100000:10000000:1.0:1790919641.027638:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 68: rc = 0 00100000:10000000:1.0:1790919641.027972:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 68: rc = 0 00100000:10000000:1.0:1790919641.028273:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 68: rc = 0 00100000:10000000:1.0:1790919641.028538:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 68: rc = 0 00100000:10000000:1.0:1790919641.028807:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 68: rc = 0 00100000:10000000:1.0:1790919641.030276:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 68: rc = 0 00100000:10000000:1.0:1790919641.030512:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 68: rc = 0 00100000:10000000:1.0:1790919641.030752:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 68: rc = 0 00100000:10000000:1.0:1790919641.030987:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 68: rc = 0 00100000:10000000:1.0:1790919641.031261:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 68: rc = 0 00100000:10000000:1.0:1790919641.031597:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 61: rc = 0 00100000:10000000:1.0:1790919641.031828:0:17041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 61: rc = 0 00000020:00000080:1.0:1790919641.033680:0:17041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790919641.033693:0:17041:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790919641.033704:0:17041:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159147a1 00000020:01000004:1.0:1790919641.033712:0:17041:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:1.0:1790919641.033735:0:17041:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790919641.033739:0:17041:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790919641.033745:0:17041:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790919641.033766:0:17041:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:1.0:1790919641.033770:0:17041:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790919641.043732:0:17041:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790919641.043770:0:17041:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1790919641.043775:0:17041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790919641.043782:0:17041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790919641.043783:0:17041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919641.043784:0:17041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919641.043786:0:17041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919641.043787:0:17041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919641.043789:0:17041:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919641.043790:0:17041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919641.043792:0:17041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919641.043795:0:17041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1790919641.043798:0:17041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919641.043799:0:17041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790919641.043800:0:17041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919641.043801:0:17041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919641.043801:0:17041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919641.043802:0:17041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919641.043803:0:17041:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919641.043805:0:17041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919641.043806:0:17041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919641.043832:0:17041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790919641.043853:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919641.043938:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.044035:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391854780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.044439:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253056 00000100:00100000:0.0:1790919641.044447:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253056 00000100:00100000:0.0:1790919641.044543:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919641.044553:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:17041:x1877914978253056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919641.044594:0:16398:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790919641.044598:0:16398:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1790919641.044606:0:16398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790919641.055483:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:17041:x1877914978253056:12345-0@lo:253:mount.lustre.0 Request processed in 10921us (11534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.055498:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919641.055602:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919641.055617:0:17041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790919641.055620:0:17041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919641.055622:0:17041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790919641.055624:0:17041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919641.055625:0:17041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919641.055626:0:17041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919641.055628:0:17041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919641.055629:0:17041:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919641.055631:0:17041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919641.055632:0:17041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790919641.055652:0:17041:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f391982800 from lustre-MDT0001 10000000:01000000:2.0:1790919641.055690:0:17041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1790919641.055693:0:17041:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790919641.055699:0:17041:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f3a68bcd40 local copy 00010000:00010000:2.0:1790919641.055716:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.055933:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919641.055971:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.056097:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1790919641.056288:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253184 00000100:00100000:3.0:1790919641.056294:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253184 00000100:00100000:3.0:1790919641.056367:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919641.056377:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:17041:x1877914978253184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919641.056547:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:17041:x1877914978253184:12345-0@lo:501:mount.lustre.0 Request processed in 171us (574us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919641.056554:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919641.056645:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253184:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790919641.056661:0:17041:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790919641.056835:0:17041:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790919641.056842:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.056853:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919641.056873:0:17041:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f391982800 10000000:01000000:0.0:1790919641.056878:0:17041:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919641.056882:0:17041:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95f3a68bcd40 10000000:01000000:0.0:1790919641.056884:0:17041:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790919641.056888:0:17041:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95f3a68bcd40 from 1 10000000:01000000:0.0:1790919641.056891:0:17041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790919641.056917:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.056924:0:17041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.056933:0:17041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919641.056950:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919641.056983:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919641.057455:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d1f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919641.057527:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253312 00000100:00100000:2.0:1790919641.057534:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253312 00000100:00100000:2.0:1790919641.057561:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919641.057570:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+12:17041:x1877914978253312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919641.057581:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919641.057595:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860eea00/0x951c50ad159147af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159147a8 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.057618:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860eea00/0x951c50ad159147af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159147a8 expref: 13 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.057629:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860eea00/0x951c50ad159147af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159147a8 expref: 13 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.057639:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860eea00, rc 0) 00000100:00100000:2.0:1790919641.057731:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+13:17041:x1877914978253312:12345-0@lo:101:mount.lustre.0 Request processed in 161us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919641.057737:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919641.057865:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919641.057880:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.057900:0:17041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919641.057920:0:17041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790919641.057968:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.057976:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919641.057984:0:17041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95f391982800 10000000:01000000:0.0:1790919641.057989:0:17041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790919641.057993:0:17041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95f391982800 from 1 10000000:01000000:0.0:1790919641.057996:0:17041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790919641.058013:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.058020:0:17041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.058028:0:17041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919641.058042:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919641.058159:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919641.058182:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d1f480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919641.058291:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253440 00000100:00100000:3.0:1790919641.058296:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253440 00000100:00100000:3.0:1790919641.058331:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919641.058338:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+13:17041:x1877914978253440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919641.058346:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919641.058355:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166c600/0x951c50ad159147bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159147b6 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.058370:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166c600/0x951c50ad159147bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159147b6 expref: 14 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.058377:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166c600/0x951c50ad159147bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159147b6 expref: 14 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.058384:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:3.0:1790919641.058425:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+14:17041:x1877914978253440:12345-0@lo:101:mount.lustre.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919641.058431:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919641.058540:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919641.058553:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.058561:0:17041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919641.058574:0:17041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790919641.058763:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.058771:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919641.058777:0:17041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790919641.058781:0:17041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919641.058786:0:17041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95f391982800 10000000:01000000:1.0:1790919641.058789:0:17041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790919641.058792:0:17041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790919641.058794:0:17041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790919641.058811:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.058818:0:17041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.058825:0:17041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919641.058838:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919641.058869:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919641.058897:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.058944:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253568 00000100:00100000:0.0:1790919641.058949:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253568 00000100:00100000:0.0:1790919641.058993:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919641.059000:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+14:17041:x1877914978253568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919641.059007:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919641.059016:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014400/0x951c50ad159147cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159147c4 expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.059030:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014400/0x951c50ad159147cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159147c4 expref: 15 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.059038:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014400/0x951c50ad159147cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159147c4 expref: 15 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.059044:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014400, rc 0) 00000100:00100000:0.0:1790919641.059440:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253568:12345-0@lo:101:mount.lustre.0 Request processed in 439us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.059447:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919641.059526:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919641.059539:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.059547:0:17041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919641.060442:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1790919641.061678:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919641.061930:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790919641.061975:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790919641.062033:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790919641.062379:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790919641.062417:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1790919641.062465:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1790919641.062516:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1790919641.062553:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790919641.062602:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790919641.062637:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1790919641.062686:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1790919641.062732:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1790919641.062766:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1790919641.062798:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790919641.062841:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790919641.062878:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1790919641.062906:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1790919641.062947:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1790919641.062976:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1790919641.063005:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1790919641.063046:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1790919641.063634:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790919641.063701:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790919641.063798:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1790919641.063806:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1790919641.063893:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919641.063956:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919641.064080:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.064346:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253696 00000100:00100000:0.0:1790919641.064354:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253696 00000100:00100000:0.0:1790919641.064438:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790919641.064448:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919641.064813:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253696:12345-0@lo:501:mount.lustre.0 Request processed in 366us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.064821:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919641.064904:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919641.064943:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919641.064985:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.065502:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.065580:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253824 00000100:00100000:1.0:1790919641.065585:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253824 00000100:00100000:1.0:1790919641.065612:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790919641.065619:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919641.065944:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253824:12345-0@lo:503:mount.lustre.0 Request processed in 324us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.065952:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919641.066032:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919641.066886:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919641.066964:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919641.067017:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.067040:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.067172:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978253952 00000100:00100000:1.0:1790919641.067178:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978253952 00000100:00100000:1.0:1790919641.067276:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919641.067287:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919641.067563:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978253952:12345-0@lo:502:mount.lustre.0 Request processed in 278us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.067570:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919641.067705:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978253952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919641.067942:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790919641.067985:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1790919641.068035:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1790919641.068108:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1790919641.068141:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1790919641.068193:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1790919641.068361:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1790919641.068393:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1790919641.068439:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1790919641.068474:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1790919641.068524:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1790919641.068568:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1790919641.068598:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1790919641.068627:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1790919641.068682:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1790919641.068717:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1790919641.068752:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1790919641.068799:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1790919641.068829:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1790919641.068856:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1790919641.068898:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1790919641.068932:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1790919641.068959:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1790919641.069015:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1790919641.069050:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1790919641.069364:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1790919641.069437:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1790919641.069473:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1790919641.069500:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1790919641.069540:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1790919641.069570:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1790919641.069598:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1790919641.069639:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1790919641.069685:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1790919641.069718:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1790919641.069757:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1790919641.069790:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1790919641.069817:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1790919641.069853:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1790919641.069881:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1790919641.069905:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1790919641.069941:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1790919641.069986:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1790919641.070018:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1790919641.070375:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919641.070444:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.070484:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac4f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.070541:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978254080 00000100:00100000:1.0:1790919641.070548:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978254080 00000100:00100000:1.0:1790919641.070630:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919641.070639:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978254080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919641.070871:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978254080:12345-0@lo:502:mount.lustre.0 Request processed in 232us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.070879:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919641.070962:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919641.071088:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1790919641.071099:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1790919641.072395:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.072418:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.072420:0:17042:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790919641.072427:0:17042:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1790919641.072429:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919641.072444:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff95f3bce44d40) 00000020:00000080:3.0:1790919641.072466:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1790919641.072471:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790919641.072533:0:17042:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790919641.072542:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159147d9 00000020:00000080:3.0:1790919641.072749:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1790919641.072754:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.072758:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.072759:0:17042:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790919641.072762:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.072765:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.072767:0:17042:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1790919641.072770:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919641.072778:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff95f3bce43380) 00000020:00000080:3.0:1790919641.072787:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1790919641.072790:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790919641.072792:0:17042:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1790919641.072794:0:17042:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1790919641.072799:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790919641.072835:0:17042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f391982800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1790919641.072846:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff95f3908ab380) 00000020:00000080:3.0:1790919641.072853:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1790919641.072911:0:17042:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790919641.072916:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159147ee 00000020:00000080:3.0:1790919641.072999:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1790919641.073006:0:17042:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790919641.073011:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x951c50ad159147f5 00080000:01000000:3.0:1790919641.073016:0:17042:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790919641.073020:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159147fc 00010000:00010000:3.0:1790919641.123484:0:17042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1790919641.123941:0:17042:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1790919641.124422:0:17042:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790919641.127349:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790919641.127364:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.127371:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.127373:0:17042:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790919641.127377:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.127382:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.127383:0:17042:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790919641.127386:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919641.127391:0:17042:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1790919641.127418:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919641.127433:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff95f3908acd40) 00000020:00000080:3.0:1790919641.127457:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790919641.127464:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919641.127544:0:17042:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790919641.127550:0:17042:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790919641.127557:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad1591480a 00010000:00080000:3.0:1790919641.127589:0:17042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3b600c800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919641.131868:0:17042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1790919641.133882:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790919641.133898:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790919641.133930:0:17042:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790919641.133952:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15914811 00000100:00080000:3.0:1790919641.133961:0:17042:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919641.133972:0:17042:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95f3b600c800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919641.134007:0:17042:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fd500 x1877914978254208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919641.134182:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978254208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790919641.134350:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919641.134417:0:17042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1790919641.134487:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.134498:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.134500:0:17042:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1790919641.134504:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790919641.134507:0:17042:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790919641.134509:0:17042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919641.134510:0:17042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919641.134512:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790919641.134514:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.134516:0:17042:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790919641.134518:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.134523:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.134524:0:17042:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1790919641.134529:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790919641.134559:0:17042:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790919641.134573:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.134576:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.134577:0:17042:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1790919641.134579:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790919641.134581:0:17042:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1790919641.134582:0:17042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919641.134584:0:17042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919641.134586:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790919641.134589:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.134590:0:17042:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790919641.134593:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790919641.134596:0:17042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1790919641.134599:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.134601:0:17042:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790919641.134603:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919641.134607:0:17042:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1790919641.134627:0:17042:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1790919641.134631:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919641.134644:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff95f3908a8000) 00000020:00000080:3.0:1790919641.134659:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1790919641.134681:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919641.134732:0:17042:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1790919641.134737:0:17042:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790919641.134742:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad1591481f 00010000:00080000:3.0:1790919641.134768:0:17042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f392712000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919641.134977:0:17042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1790919641.135412:0:17042:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790919641.135458:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1790919641.136356:0:17042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919641.136413:0:17042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1790919641.136501:0:17042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1790919641.138453:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978254208 00000100:00100000:1.0:1790919641.138464:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978254208 00000100:00100000:1.0:1790919641.138532:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919641.138539:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978254208:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790919641.138569:0:16412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1790919641.138602:0:16412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15914826 00000004:00100000:1.0:1790919641.138628:0:16412:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790919641.138633:0:16412:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1790919641.139124:0:17047:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790919641.139134:0:17047:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790919641.139937:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919641.139949:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790919641.139983:0:17042:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790919641.140002:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad1591482d 00000100:00080000:2.0:1790919641.140011:0:17042:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919641.140021:0:17042:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f392712000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919641.140981:0:17042:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e27b80 x1877914978254336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919641.141006:0:17042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790919641.141305:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919641.141311:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919641.141313:0:17042:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790919641.141316:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790919641.141319:0:17042:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1790919641.141321:0:17042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919641.141322:0:17042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919641.141324:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790919641.141326:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919641.141328:0:17042:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790919641.141330:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790919641.141334:0:17042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1790919641.141337:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919641.141339:0:17042:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790919641.141341:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790919641.141345:0:17042:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1790919641.141367:0:17042:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790919641.141370:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919641.141382:0:17042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff95f3bdfe3380) 00000020:00000080:2.0:1790919641.141400:0:17042:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1790919641.141405:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790919641.141480:0:17042:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790919641.141487:0:17042:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790919641.141493:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad1591483b 00010000:00080000:2.0:1790919641.141534:0:17042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f387168800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919641.141755:0:17042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790919641.141914:0:17042:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790919641.141937:0:17042:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790919641.144992:0:17042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919641.145111:0:17042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790919641.145180:0:17042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1790919641.145184:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978254336:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790919641.145238:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978254336 offset 0 length 520: 4 00000040:00080000:2.0:1790919641.146557:0:17049:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790919641.146563:0:17049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790919641.149894:0:17042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790919641.149910:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790919641.149949:0:17042:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790919641.149970:0:17042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15914842 00000100:00080000:3.0:1790919641.149980:0:17042:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919641.149992:0:17042:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f387168800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919641.150027:0:17042:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860ffb80 x1877914978254464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919641.150107:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978254464:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790919641.150158:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978254464 offset 0 length 520: 4 00000100:00080000:3.0:1790919641.150406:0:17042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790919641.150467:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.150472:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.150475:0:17042:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790919641.150478:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.150482:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.150484:0:17042:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790919641.150487:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790919641.150489:0:17042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790919641.150491:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.150494:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.150495:0:17042:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790919641.150504:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.150508:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.150509:0:17042:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790919641.150513:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790919641.150591:0:17042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.150595:0:17042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.150597:0:17042:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790919641.150600:0:17042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1790919641.150774:0:17041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1790919641.150805:0:17041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790919641.150829:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.150841:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919641.150850:0:17041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f391982800 from 1 10000000:01000000:2.0:1790919641.150853:0:17041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919641.150877:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.150886:0:17041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.150897:0:17041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.150925:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919641.150971:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.150992:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.151376:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978254592 00000100:00100000:0.0:1790919641.151384:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978254592 00000100:00100000:0.0:1790919641.151428:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790919641.151437:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+15:17041:x1877914978254592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919641.151451:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919641.151471:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914849 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.151496:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914849 expref: 16 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.151506:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914849 expref: 16 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.151514:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014800, rc 0) 00000100:00100000:0.0:1790919641.151895:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:17041:x1877914978254592:12345-0@lo:101:mount.lustre.0 Request processed in 458us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.151902:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919641.153566:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919641.153591:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.153603:0:17041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.154308:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254720:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790919641.154377:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.154414:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919641.154483:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978254720 00000100:00100000:3.0:1790919641.154491:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978254720 00000100:00100000:3.0:1790919641.154528:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919641.154537:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:17041:x1877914978254720:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790919641.154556:0:16401:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790919641.154572:0:16401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790919641.154576:0:16401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790919641.154676:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:17041:x1877914978254720:12345-0@lo:256:mount.lustre.0 Request processed in 130us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919641.154683:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919641.154976:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254720:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790919641.155715:0:17041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919641.155736:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.155749:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919641.155757:0:17041:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f391982800 from 1 10000000:01000000:2.0:1790919641.155760:0:17041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919641.155788:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.155808:0:17041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.155818:0:17041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.155835:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919641.155875:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.155903:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.156131:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978254848 00000100:00100000:0.0:1790919641.156138:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978254848 00000100:00100000:0.0:1790919641.156174:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790919641.156182:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:17041:x1877914978254848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919641.156193:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919641.156364:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914857 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.156388:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.156398:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.156407:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014200, rc 0) 00000100:00100000:0.0:1790919641.156443:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978254848:12345-0@lo:101:mount.lustre.0 Request processed in 261us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.156457:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790919641.156796:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919641.156809:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.156818:0:17041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919641.156972:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919641.157006:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919641.157038:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.157086:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.157875:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978254976 00000100:00100000:1.0:1790919641.157883:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978254976 00000100:00100000:1.0:1790919641.157921:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919641.157930:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978254976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919641.158170:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978254976:12345-0@lo:501:mount.lustre.0 Request processed in 241us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.158178:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919641.158446:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978254976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919641.158484:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919641.158526:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.159028:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.159183:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255104 00000100:00100000:1.0:1790919641.159190:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255104 00000100:00100000:1.0:1790919641.159343:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919641.159351:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919641.159508:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255104:12345-0@lo:503:mount.lustre.0 Request processed in 158us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.159515:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790919641.159596:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919641.159972:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919641.160043:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919641.160127:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.160146:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.160315:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255232 00000100:00100000:1.0:1790919641.160320:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255232 00000100:00100000:1.0:1790919641.160342:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790919641.160349:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919641.160504:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255232:12345-0@lo:502:mount.lustre.0 Request processed in 155us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.160518:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919641.160602:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919641.160820:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790919641.160865:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1790919641.160912:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1790919641.160946:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1790919641.160978:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1790919641.161025:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1790919641.163786:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1790919641.163867:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1790919641.163934:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790919641.163993:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1790919641.164027:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1790919641.164155:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919641.164292:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.164325:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919641.164424:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255360 00000100:00100000:3.0:1790919641.164432:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255360 00000100:00100000:3.0:1790919641.164475:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919641.164483:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919641.164676:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255360:12345-0@lo:502:mount.lustre.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919641.164683:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919641.164769:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919641.164855:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1790919641.164865:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790919641.167349:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919641.167361:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919641.167364:0:17051:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790919641.167373:0:17051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f391982800 00000020:00000080:2.0:1790919641.167375:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919641.167382:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919641.167392:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919641.167393:0:17051:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790919641.167397:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919641.167400:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919641.167401:0:17051:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790919641.167405:0:17051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f391982800 00000020:00000080:2.0:1790919641.167407:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919641.167464:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.169104:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.169110:0:17051:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790919641.169117:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.169122:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.169123:0:17051:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919641.169134:0:17051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f391982800 00000020:00000080:3.0:1790919641.169137:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919641.169179:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.169183:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.169185:0:17051:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919641.169187:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919641.169190:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.169191:0:17051:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790919641.169195:0:17051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f391982800 00000020:00000080:3.0:1790919641.169197:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919641.169379:0:17051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919641.169383:0:17051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919641.169385:0:17051:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790919641.169388:0:17051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1790919641.175121:0:17041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790919641.175160:0:17041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919641.175180:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175193:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919641.175256:0:17041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919641.175260:0:17041:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f391982800 10000000:01000000:3.0:1790919641.175263:0:17041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f391982800 10000000:01000000:3.0:1790919641.175267:0:17041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919641.175273:0:17041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f391982800 from 1 10000000:01000000:3.0:1790919641.175276:0:17041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919641.175309:0:17041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175319:0:17041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175337:0:17041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919641.175361:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919641.175433:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.175471:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919641.175497:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255488 00000100:00100000:3.0:1790919641.175504:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255488 00000100:00100000:3.0:1790919641.175541:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919641.175550:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:17041:x1877914978255488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919641.175562:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919641.175574:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166de00/0x951c50ad1591486c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914865 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175597:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166de00/0x951c50ad1591486c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914865 expref: 18 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175606:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166de00/0x951c50ad1591486c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914865 expref: 18 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175614:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166de00, rc 0) 00000100:00100000:3.0:1790919641.175648:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255488:12345-0@lo:101:mount.lustre.0 Request processed in 100us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919641.175654:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919641.175707:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919641.175721:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919641.175734:0:17041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919641.176298:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1790919641.176713:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919641.176957:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1790919641.177000:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1790919641.177035:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1790919641.177111:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1790919641.177147:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1790919641.177208:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1790919641.177248:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1790919641.177297:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1790919641.177349:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1790919641.177391:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1790919641.177430:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1790919641.177481:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1790919641.177517:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1790919641.177548:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1790919641.177588:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1790919641.177623:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1790919641.177657:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1790919641.177716:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1790919641.177750:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1790919641.177783:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1790919641.177836:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1790919641.177870:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1790919641.177905:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1790919641.177972:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1790919641.178008:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1790919641.178041:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1790919641.178135:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1790919641.178170:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1790919641.178254:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1790919641.178263:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1790919641.178367:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919641.178429:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.178470:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.178729:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255616 00000100:00100000:0.0:1790919641.178736:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255616 00000100:00100000:0.0:1790919641.178781:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790919641.178790:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919641.179003:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255616:12345-0@lo:501:mount.lustre.0 Request processed in 214us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.179011:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790919641.190172:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919641.190237:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919641.190317:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.190358:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.190468:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255744 00000100:00100000:0.0:1790919641.190475:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255744 00000100:00100000:0.0:1790919641.190523:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790919641.190531:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919641.190721:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255744:12345-0@lo:503:mount.lustre.0 Request processed in 190us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.190730:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790919641.190812:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790919641.191386:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919641.191446:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919641.191492:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.191516:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.191578:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978255872 00000100:00100000:0.0:1790919641.191584:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978255872 00000100:00100000:0.0:1790919641.191614:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919641.191621:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919641.191822:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978255872:12345-0@lo:502:mount.lustre.0 Request processed in 201us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.191829:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790919641.191903:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978255872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919641.198010:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790919641.198235:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1790919641.198272:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1790919641.198324:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1790919641.198362:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1790919641.198411:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1790919641.198446:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1790919641.198495:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1790919641.198542:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1790919641.198578:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1790919641.198625:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1790919641.198684:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1790919641.198718:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1790919641.198748:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1790919641.198797:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1790919641.198831:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1790919641.198865:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1790919641.198915:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1790919641.198951:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1790919641.198987:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1790919641.199036:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1790919641.201847:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1790919641.201901:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1790919641.201993:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1790919641.202029:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1790919641.202278:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1790919641.202337:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1790919641.202375:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1790919641.202408:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1790919641.202455:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1790919641.202492:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1790919641.202525:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1790919641.202558:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1790919641.202622:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1790919641.202660:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1790919641.202719:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1790919641.202754:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1790919641.202789:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1790919641.202835:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1790919641.202888:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1790919641.202926:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1790919641.202964:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1790919641.203027:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1790919641.203948:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1790919641.203991:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1790919641.204048:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1790919641.204178:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1790919641.204215:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1790919641.204284:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978256000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919641.204366:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.204403:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.204731:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256000 00000100:00100000:0.0:1790919641.204741:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256000 00000100:00100000:0.0:1790919641.204783:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919641.204792:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978256000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919641.204984:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978256000:12345-0@lo:502:mount.lustre.0 Request processed in 191us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.204992:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790919641.205710:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978256000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919641.205844:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1790919641.205885:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1790919641.205918:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978256128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919641.205971:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.206001:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3918543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.206046:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256128 00000100:00100000:0.0:1790919641.206176:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256128 00000100:00100000:0.0:1790919641.206208:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790919641.206215:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978256128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919641.206366:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978256128:12345-0@lo:502:mount.lustre.0 Request processed in 150us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.206374:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1790919641.206521:0:16412:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919641.206566:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978254208:12345-0@lo:38:llog_process_th.0 Request processed in 68026us (72215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.206575:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919641.206620:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919641.206628:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790919641.206636:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790919641.206641:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790919641.206644:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790919641.206655:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978254208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919641.206723:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978256256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919641.207697:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.207698:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978256128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919641.207843:0:17041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1790919641.207862:0:17041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:0.0:1790919641.207877:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256256 00000100:00100000:0.0:1790919641.207882:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256256 00000100:00100000:0.0:1790919641.207922:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919641.207929:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1877914978256256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919641.207958:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919641.208014:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3461:x1877914978256256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.208021:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919641.208116:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978256256:0@lo:41:osp-pre-0-1.0 00000020:01000004:0.0:1790919641.210135:0:17057:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790919641.210151:0:17057:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff95f3b42b0000) 00000020:00000080:0.0:1790919641.210173:0:17057:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1790919641.210245:0:17057:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f391982800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790919641.210250:0:17057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f391982800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790919641.210252:0:17057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f391982800 3 00010000:00080000:0.0:1790919641.210287:0:17057:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3ac516800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919641.212325:0:17057:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1790919641.212514:0:17057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1790919641.212555:0:17057:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790919641.212565:0:17057:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x951c50ad1591487a 00000100:00080000:0.0:1790919641.212574:0:17057:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919641.212583:0:17057:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff95f3ac516800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919641.212616:0:17057:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285599880 x1877914978256384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919641.212689:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978256384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919641.212876:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790919641.216320:0:17057:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790919641.216996:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256384 00000100:00100000:1.0:1790919641.217006:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256384 00000100:00100000:1.0:1790919641.217045:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919641.217072:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978256384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790919641.217099:0:16405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1790919641.217137:0:16405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x951c50ad15914881 00000004:00100000:1.0:1790919641.217154:0:16405:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790919641.217189:0:16405:0:(import.c:65:import_set_state_nolock()) ffff95f3bce55800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919641.217280:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1877914978256384:12345-0@lo:38:llog_process_th.0 Request processed in 227us (4404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.217295:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790919641.217347:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f285599880 x1877914978256384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919641.217360:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919641.217368:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790919641.217376:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790919641.217381:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790919641.217384:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3ac516800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790919641.217390:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978256384:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790919641.218365:0:17057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1790919641.220473:0:17041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790919641.220516:0:17041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919641.220532:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.220545:0:17041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919641.220591:0:17041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919641.220593:0:17041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919641.220594:0:17041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919641.220596:0:17041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919641.220597:0:17041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919641.220598:0:17041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919641.220599:0:17041:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919641.220601:0:17041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919641.220602:0:17041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919641.220606:0:17041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1790919641.220608:0:17041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919641.220610:0:17041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919641.220614:0:17041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919641.220615:0:17041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919641.220616:0:17041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919641.220617:0:17041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919641.220618:0:17041:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919641.220619:0:17041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919641.220620:0:17041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919641.220644:0:17041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790919641.220662:0:17041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978256512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919641.220945:0:17041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919641.220987:0:17041:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386445240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.221440:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256512 00000100:00100000:0.0:1790919641.221449:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256512 00000100:00100000:0.0:1790919641.221489:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919641.221497:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17041:x1877914978256512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919641.221524:0:16398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790919641.221537:0:16398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790919641.244142:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 20000000:01000000:1.0:1790919641.265642:0:16398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790919641.265676:0:16398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1790919641.265708:0:16422:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790919641.265719:0:16422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000001:00100000:1.0:1790919641.265726:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1790919641.265756:0:16422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.265778:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914785 expref: 18 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.265787:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914849 expref: 18 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.265794:0:16422:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.265836:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914849 expref: 18 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.265851:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914849 expref: 18 pid: 16400 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.266110:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978256640:0@lo:104: 00000100:00100000:2.0:1790919641.266177:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919641.266230:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914785 expref: 18 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.266239:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914785 expref: 18 pid: 16401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.266249:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978256768:0@lo:104: 00000100:00100000:2.0:1790919641.266274:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.266294:0:16422:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919641.266306:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256640 00000100:00100000:1.0:1790919641.266319:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256640 00000100:00100000:2.0:1790919641.266323:0:16389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256768 00000100:00100000:2.0:1790919641.266331:0:16389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256768 00000100:00100000:1.0:1790919641.266393:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919641.266404:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:16422:x1877914978256640:12345-0@lo:104: 00010000:00010000:1.0:1790919641.266423:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919641.266525:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919641.266532:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:16422:x1877914978256640:12345-0@lo:104: Request processed in 131us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919641.266541:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1790919641.266912:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919641.266922:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.266930:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860eee00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919641.266935:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.266944:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919641.266951:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919641.266956:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919641.266992:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.267013:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919641.267035:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.267041:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860eee00/0x951c50ad15914849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914850 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.267073:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919641.267075:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919641.267077:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919641.267101:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978256896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919641.267219:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919641.267270:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978256896 00000100:00100000:0.0:1790919641.267275:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978256896 00010000:00010000:0.0:1790919641.267313:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914849 expref: 19 pid: 16400 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919641.267339:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919641.267348:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3458:x1877914978256896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919641.267360:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919641.267365:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914849 expref: 19 pid: 16400 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.267376:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914849 expref: 19 pid: 16400 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919641.267389:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919641.267423:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3458:x1877914978256896:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.267437:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919641.267694:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978256896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919641.269020:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919641.269037:0:16389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:16422:x1877914978256768:12345-0@lo:104: 00010000:00010000:2.0:1790919641.269067:0:16389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269144:0:16389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919641.269151:0:16389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:16422:x1877914978256768:12345-0@lo:104: Request processed in 122us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919641.269158:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790919641.269182:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919641.269187:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269194:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919641.269210:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269219:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919641.269225:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919641.269231:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919641.269262:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269268:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919641.269287:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269294:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ee000/0x951c50ad15914785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591478c expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269313:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919641.269315:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919641.269316:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919641.269336:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978257024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919641.269370:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919641.269416:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257024 00000100:00100000:2.0:1790919641.269423:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257024 00010000:00010000:2.0:1790919641.269454:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914785 expref: 19 pid: 16401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.269476:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919641.269491:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3459:x1877914978257024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919641.269504:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919641.269510:0:16393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914785 expref: 19 pid: 16401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269525:0:16393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914785 expref: 19 pid: 16401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269545:0:16393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269554:0:16393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790919641.269571:0:16393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003852935s 00010000:00010000:2.0:1790919641.269576:0:16393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269583:0:16393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269590:0:16393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269596:0:16393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269602:0:16393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919641.269607:0:16393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269625:0:16393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269635:0:16393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.269645:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919641.269687:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3459:x1877914978257024:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919641.269693:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919641.269732:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978257024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919641.270384:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014800/0x951c50ad15914850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914849 expref: 18 pid: 16400 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.270396:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978256640:0@lo:104: 00010000:00010000:2.0:1790919641.270406:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ef600/0x951c50ad1591478c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914785 expref: 17 pid: 16401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919641.270413:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978256768:0@lo:104: 00010000:00010000:2.0:1790919641.270428:0:16422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.270437:0:16422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.270443:0:16422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919641.270461:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee800/0x951c50ad15914888 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919641.287653:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:17041:x1877914978256512:12345-0@lo:253:mount.lustre.0 Request processed in 66145us (66697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.287684:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919641.289141:0:17041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17041:1877914978256512:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790919641.289168:0:17041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790919641.289172:0:17041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919641.289175:0:17041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919641.289178:0:17041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919641.290777:0:17041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919641.290791:0:17041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919641.290806:0:17041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919641.290807:0:17041:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919641.290811:0:17041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919641.290812:0:17041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790919641.290843:0:17041:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790919641.303127:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919641.304790:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919641.305221:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919641.305562:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919641.305864:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919641.306019:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919641.308552:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919641.308912:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919641.309607:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919641.309821:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919641.311765:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919641.312352:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:2.0:1790919641.316736:0:17041:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1790919641.317152:0:17063:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1790919641.317161:0:17063:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790919641.317474:0:17064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1790919641.317592:0:17064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1790919641.320190:0:17041:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1790919641.322013:0:17064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790919641.322257:0:17064:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1790919641.322592:0:17041:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1790919641.322754:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919641.323295:0:17065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17065:1877914978257152:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790919641.323400:0:17065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:1.0:1790919641.323499:0:17041:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790919641.323508:0:17041:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1790919641.323701:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919641.324430:0:17065:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1790919641.325730:0:17041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790919641.326851:0:17041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1790919641.327300:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257152 00000100:00100000:3.0:1790919641.327312:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257152 00000100:00100000:2.0:1790919641.327547:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790919641.327560:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17065:x1877914978257152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790919641.327739:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17065:x1877914978257152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 181us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919641.327748:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919641.327842:0:17065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17065:1877914978257152:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1790919641.327896:0:17065:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790919641.327958:0:17065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17065:1877914978257280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790919641.328008:0:17065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.328108:0:17065:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c000 going to sleep for 11 seconds 00000040:01000000:1.0:1790919641.328233:0:17041:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1790919641.328514:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257280 00000100:00100000:0.0:1790919641.328521:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257280 00000100:00100000:0.0:1790919641.328560:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919641.328570:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17065:x1877914978257280:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1790919641.328588:0:17041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919641.328788:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17065:x1877914978257280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 219us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.328797:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919641.329095:0:17065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17065:1877914978257280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790919641.329257:0:17065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17065:1877914978257408:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790919641.329302:0:17065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.329335:0:17065:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919641.329419:0:16417:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257408 00000100:00100000:2.0:1790919641.329426:0:16417:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257408 00000100:00100000:2.0:1790919641.329472:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919641.329481:0:16417:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17065:x1877914978257408:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790919641.329540:0:16417:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17065:x1877914978257408:12345-0@lo:900:lod0001_rec0000.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919641.329547:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790919641.329744:0:17065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f2860fc380 x1877914978257408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919657 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919641.329756:0:17065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17065:1877914978257408:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790919641.329811:0:17065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17065:1877914978257536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790919641.329844:0:17065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919641.329875:0:17065:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790919641.330175:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257536 00000100:00100000:0.0:1790919641.330181:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257536 00000100:00100000:0.0:1790919641.330226:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919641.330235:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17065:x1877914978257536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790919641.330482:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17065:x1877914978257536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 247us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919641.330491:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919641.330690:0:17065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17065:1877914978257536:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1790919641.330750:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790919641.332698:0:17041:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/8/4) registered 00000040:00080000:3.0:1790919641.336109:0:17065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790919641.336202:0:17065:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790919641.336208:0:17065:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1790919641.339257:0:17041:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790919641.387835:0:17041:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790919641.388231:0:17041:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa204c152b988 00100000:10000000:1.0:1790919641.388244:0:17041:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790919641.389906:0:17041:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919641.389976:0:17041:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919641.389994:0:17041:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790919641.390023:0:17041:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00010000:00010000:3.0:1790919641.757271:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919642.078627:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790919642.272641:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919642.275123:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:3.0:1790919642.781990:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790919642.782872:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790919642.782881:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f391982800 from 8 10000000:01000000:0.0:1790919642.782887:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919642.782949:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919642.782963:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919642.782976:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919642.783011:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978257664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919642.783127:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919642.783193:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798300 going to sleep for 11 seconds 00000100:00100000:2.0:1790919642.783722:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257664 00000100:00100000:2.0:1790919642.783734:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257664 00000100:00100000:2.0:1790919642.783804:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790919642.783815:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:16403:x1877914978257664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919642.783842:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919642.783862:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591488f expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.783895:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591488f expref: 17 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.783908:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591488f expref: 17 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.783919:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee800, rc 0) 00000100:00100000:2.0:1790919642.783991:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978257664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919642.783998:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790919642.784112:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978257664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919642.784133:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919642.784143:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919642.784211:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978257792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790919642.784254:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919642.784293:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919642.784357:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257792 00000100:00100000:1.0:1790919642.784371:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257792 00000100:00100000:1.0:1790919642.784407:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919642.784415:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978257792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790919642.784432:0:16398:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919642.784451:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919642.784454:0:16398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1790919642.784570:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978257792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919642.784578:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790919642.784647:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978257792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790919642.784719:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919642.784727:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.784737:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919642.784748:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919642.784752:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3aee80800 from 8 10000000:01000000:2.0:1790919642.784755:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919642.784777:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.784785:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.784800:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919642.784816:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978257920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919642.784844:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919642.784870:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d1fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919642.785986:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978257920 00000100:00100000:0.0:1790919642.785998:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978257920 00000100:00100000:0.0:1790919642.786088:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919642.786100:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978257920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919642.786136:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919642.786156:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591489d expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919642.786186:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591489d expref: 18 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919642.786198:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591489d expref: 18 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919642.786207:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014800, rc 0) 00000100:00100000:0.0:1790919642.786289:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978257920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919642.786297:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790919642.790899:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978257920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919642.790940:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919642.790956:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919642.791165:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978258048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919642.791260:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919642.791308:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d1fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919642.791419:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258048 00000100:00100000:1.0:1790919642.791428:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258048 00000100:00100000:1.0:1790919642.791497:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919642.791508:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978258048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790919642.791538:0:16400:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919642.791558:0:16400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919642.791561:0:16400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1790919642.791682:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978258048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 175us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919642.791691:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919642.791735:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978258048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790919642.791784:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919642.791793:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919642.791804:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919643.292165:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00000040:00080000:0.0:1790919643.296478:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790919643.804273:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919644.317174:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00010000:00010000:3.0:1790919644.828907:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919645.343473:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00000001:02000400:3.0:1790919645.766299:0:17307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790919645.853486:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919646.364126:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 0 seconds 00000100:00100000:2.0:1790919646.620879:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919646.620901:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978258176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919646.620968:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919646.621194:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258176 00000100:00100000:2.0:1790919646.621203:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258176 00000100:00100000:2.0:1790919646.621247:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919646.621256:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978258176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919646.621294:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1790919646.621305:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790919646.621309:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790919646.621312:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919646.621317:0:477:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1790919646.621321:0:477:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790919646.621334:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f3b5a26800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919646.621343:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978258176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919646.621349:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919646.621353:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fce00 x1877914978258432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919646.621369:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919646.621372:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919646.621375:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919646.621378:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919646.621395:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919646.621398:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919646.621401:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919646.621404:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790919646.621419:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919646.621427:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978258304:0@lo:400:kworker.0 00000100:00100000:2.0:1790919646.621437:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978258432:0@lo:38:kworker.0 00000100:00100000:3.0:1790919646.621460:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919646.621462:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919646.621489:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978258560:0@lo:400:kworker.0 00000100:00100000:2.0:1790919646.621491:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258432 00000100:00100000:2.0:1790919646.621494:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258432 00000100:00100000:2.0:1790919646.621509:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919646.621513:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978258432:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1790919646.621514:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919646.621531:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:2.0:1790919646.621534:0:16412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000100:00100000:3.0:1790919646.621536:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978258688:0@lo:400:kworker.0 00000100:00100000:3.0:1790919646.621556:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1790919646.621564:0:16412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad159148ab 00000004:00100000:2.0:1790919646.621578:0:16412:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1790919646.621581:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258304 00000001:00000004:2.0:1790919646.621583:0:16412:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1790919646.621584:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258304 00000100:00100000:3.0:1790919646.621609:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790919646.621615:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:3460:x1877914978258304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919646.621678:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:3460:x1877914978258304:12345-0@lo:400:kworker.0 Request processed in 62us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919646.621684:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790919646.621707:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258560 00000100:00100000:3.0:1790919646.621711:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258560 00000100:00100000:3.0:1790919646.621731:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258688 00000100:00100000:3.0:1790919646.621733:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258688 00000100:00100000:3.0:1790919646.621745:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919646.621751:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978258560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919646.621783:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978258560:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919646.621789:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919646.621800:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790919646.621806:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978258688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919646.621831:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978258688:12345-0@lo:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919646.621831:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978258176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919646.621837:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919646.621868:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978258304:0@lo:400:kworker.0 00010000:00080000:3.0:1790919646.621870:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f2860ff480 x1877914978258688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919646.621880:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978258688:0@lo:400:kworker.0 00010000:00080000:3.0:1790919646.621890:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f2860fdf80 x1877914978258560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919646.621898:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978258560:0@lo:400:kworker.0 00000100:00080000:2.0:1790919646.655002:0:16412:0:(import.c:65:import_set_state_nolock()) ffff95f383f29800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919646.655218:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978258432:12345-0@lo:38:kworker.0 Request processed in 33700us (33751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919646.655228:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919646.655284:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919646.655293:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790919646.655301:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790919646.655306:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790919646.655309:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790919646.655322:0:3457:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000b9fc0d3): req@ffff95f2860fed80 x1877914978251648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919646.659544:0:16449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919646.659590:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919646.660857:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978258432:0@lo:38:kworker.0 00000100:00100000:1.0:1790919646.661279:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919646.661315:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978251648 00000100:00100000:2.0:1790919646.661323:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978251648 00000100:00100000:2.0:1790919646.661366:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919646.661375:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16449:x1877914978251648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790919646.661483:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16449:x1877914978251648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919646.661491:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919646.661534:0:16449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16449:1877914978251648:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1790919646.661572:0:16449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790919646.661606:0:16449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16449:1877914978258944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790919646.661671:0:16449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919646.661693:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258944 00000100:00100000:2.0:1790919646.661697:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258944 00000100:00100000:2.0:1790919646.661715:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919646.661721:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16449:x1877914978258944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790919646.662829:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16449:x1877914978258944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1105us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919646.662838:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919646.662873:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919646.662890:0:16449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16449:1877914978258944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790919646.663151:0:16449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16449:1877914978259072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790919646.663181:0:16449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919646.663214:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259072 00000100:00100000:2.0:1790919646.663218:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259072 00000100:00100000:2.0:1790919646.663242:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919646.663249:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16449:x1877914978259072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790919646.663300:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16449:x1877914978259072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919646.663306:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919646.663323:0:16449:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919646.663336:0:16449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:16449:1877914978259072:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1790919646.663372:0:16449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919646.665015:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978258816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919646.665147:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919646.667146:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978258816 00000100:00100000:0.0:1790919646.667159:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978258816 00000100:00100000:0.0:1790919646.667218:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919646.667228:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978258816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919646.667263:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919646.667336:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978258816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919646.667344:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919646.669245:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978258816:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790919646.672346:0:16449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790919646.672424:0:16449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 15, retries 0 00000004:00080000:2.0:1790919646.672430:0:16449:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790919646.876602:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919647.902833:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919648.485955:0:17460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec33a41f0 20000000:00000080:3.0:1790919648.485976:0:17460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f386980c00 uarg=0000000000000000 20000000:01000000:3.0:1790919648.487375:0:17460:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790919648.487386:0:17460:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790919648.487391:0:17460:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790919648.488348:0:17461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1790919648.488578:0:17460:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790919648.501204:0:17460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790919648.501236:0:17460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919648.501257:0:17460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914754 expref: 17 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919648.501265:0:17460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919648.501272:0:17460:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919648.501415:0:17460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919648.501431:0:17460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919648.501445:0:17460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17460:1877914978259200:0@lo:104: 00000100:00100000:2.0:1790919648.501504:0:17460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919648.501561:0:17460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914754 expref: 17 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919648.501570:0:17460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914754 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919648.501578:0:17460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17460:1877914978259328:0@lo:104: 00000100:00100000:2.0:1790919648.501598:0:17460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919648.501651:0:17460:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919648.501706:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259328 00000100:00100000:0.0:1790919648.501706:0:16389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259200 00000100:00100000:1.0:1790919648.501714:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259328 00000100:00100000:0.0:1790919648.501715:0:16389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259200 00000100:00100000:0.0:1790919648.501763:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919648.501771:0:16389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:17460:x1877914978259328:12345-0@lo:104: 00010000:00010000:0.0:1790919648.501785:0:16389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.502001:0:16389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919648.502008:0:16389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:17460:x1877914978259328:12345-0@lo:104: Request processed in 238us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919648.502016:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919648.502034:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919648.502040:0:16389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:17460:x1877914978259200:12345-0@lo:104: 00010000:00010000:1.0:1790919648.502047:0:16389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.502105:0:16389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790919648.502111:0:16389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:17460:x1877914978259200:12345-0@lo:104: Request processed in 71us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919648.502116:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790919648.502162:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919648.502168:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502175:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919648.502179:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502188:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919648.502195:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919648.502200:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919648.502233:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502240:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919648.502261:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502268:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ee200/0x951c50ad15914754 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591475b expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502301:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919648.502304:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502309:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919648.502312:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502318:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919648.502324:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919648.502329:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919648.502342:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502347:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919648.502359:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502365:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591485e expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502378:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919648.502379:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919648.502381:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919648.502392:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978259456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919648.502434:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919648.502477:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259456 00000100:00100000:0.0:1790919648.502481:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259456 00010000:00010000:0.0:1790919648.502500:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914754 expref: 18 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919648.502521:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919648.502527:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:3461:x1877914978259456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919648.502537:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919648.502541:0:16393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914754 expref: 18 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502549:0:16393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914754 expref: 18 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919648.502563:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919648.502587:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:3461:x1877914978259456:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919648.502593:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919648.502643:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978259456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919648.502834:0:17460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17460:1877914978259200:0@lo:104: 00010000:00010000:2.0:1790919648.502842:0:17460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166d800/0x951c50ad1591475b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914754 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919648.502853:0:17460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17460:1877914978259328:0@lo:104: 00010000:00010000:2.0:1790919648.502872:0:17460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919648.503149:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919648.503156:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919648.503166:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978259584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919648.503243:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919648.503318:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259584 00000100:00100000:1.0:1790919648.503322:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259584 00010000:00010000:1.0:1790919648.503343:0:16392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919648.503370:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919648.503377:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:3459:x1877914978259584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919648.503393:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919648.503398:0:16392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503408:0:16392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503419:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014200/0x951c50ad1591485e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914857 expref: 17 pid: 16400 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503431:0:16392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503439:0:16392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503450:0:16392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503458:0:16392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503464:0:16392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503469:0:16392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503474:0:16392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919648.503478:0:16392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503497:0:16392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503519:0:16392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919648.503529:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919648.503558:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:3459:x1877914978259584:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919648.503565:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790919648.503568:0:17460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919648.503576:0:17460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919648.503582:0:17460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166ca00/0x951c50ad159148b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919648.503590:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978259584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919648.928413:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790919649.756163:0:16403:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919649.756170:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f391982800 from 13 10000000:01000000:1.0:1790919649.756175:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919649.756220:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.756232:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.756243:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919649.756269:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978259712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919649.756346:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919649.756397:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919649.757957:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259712 00000100:00100000:2.0:1790919649.757968:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259712 00000100:00100000:2.0:1790919649.758158:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919649.758170:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+16:16403:x1877914978259712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919649.758186:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919649.758205:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159148b9 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919649.758229:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159148b9 expref: 17 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919649.758240:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159148b9 expref: 17 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919649.758249:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee000, rc 0) 00000100:00100000:2.0:1790919649.758425:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978259712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919649.758432:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790919649.758511:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978259712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919649.758528:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.758554:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919649.758626:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978259840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919649.758661:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919649.758776:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919649.758861:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259840 00000100:00100000:2.0:1790919649.758871:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259840 00000100:00100000:3.0:1790919649.761024:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790919649.761091:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978259840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919649.761486:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978259840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919649.761494:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790919649.761537:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978259840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919649.761585:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978259968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919649.761651:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919649.761687:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919649.761803:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978259968 00000100:00100000:2.0:1790919649.761810:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978259968 00000100:00100000:2.0:1790919649.761878:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790919649.761887:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978259968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919649.762077:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978259968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919649.762085:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919649.762448:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978259968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790919649.763143:0:17521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790919649.763192:0:16403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790919649.763210:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919649.763219:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919649.763241:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919649.763251:0:16403:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919649.763254:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3aee80800 from 13 10000000:01000000:0.0:1790919649.763256:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919649.763282:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919649.763290:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919649.763299:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919649.763315:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978260096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919649.763351:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919649.766845:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919649.767513:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260096 00000100:00100000:1.0:1790919649.767524:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260096 00000100:00100000:1.0:1790919649.767577:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919649.767586:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+17:16403:x1877914978260096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919649.767600:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919649.767629:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159148c7 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.767754:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159148c7 expref: 18 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.767765:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159148c7 expref: 18 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.767773:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1ca00, rc 0) 00000100:00100000:1.0:1790919649.767842:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978260096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (4490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919649.767862:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790919649.767962:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978260096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919649.767979:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919649.767988:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919649.768092:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978260224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919649.768124:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919649.768144:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919649.768283:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260224 00000100:00100000:1.0:1790919649.768288:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260224 00000100:00100000:1.0:1790919649.768315:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790919649.768321:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978260224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919649.768551:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978260224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919649.768558:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790919649.768858:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978260224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919649.768889:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978260352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919649.768929:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919649.768958:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919649.769003:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260352 00000100:00100000:1.0:1790919649.769008:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260352 00000100:00100000:1.0:1790919649.769205:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790919649.769213:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978260352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919649.769369:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:16403:x1877914978260352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919649.769376:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790919649.769495:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978260352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790919649.774169:0:17522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790919649.774424:0:16403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790919649.774446:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919649.774458:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919649.774469:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919649.948385:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919650.972389:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919651.741967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.741974:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919651.741977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.741980:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919651.741998:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.742002:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919651.742004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.742007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790919651.742040:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978260864:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742141:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919651.742177:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790919651.742184:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978260480:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742211:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919651.742237:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978260992:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742263:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919651.742288:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978260608:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742337:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919651.742358:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919651.742365:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978260736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742390:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919651.742444:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260864 00000100:00100000:2.0:1790919651.742452:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260864 00000100:00100000:2.0:1790919651.742482:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260608 00000100:00100000:2.0:1790919651.742485:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260608 00000100:00100000:2.0:1790919651.742503:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919651.742512:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978260864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742567:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978260864:12345-0@lo:400:kworker.0 Request processed in 56us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919651.742574:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919651.742603:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919651.742609:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978260608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742640:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978260608:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919651.742646:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919651.742663:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790919651.742672:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978261120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919651.742696:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919651.742735:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978260608:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.742759:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978261120 00000100:00100000:2.0:1790919651.742762:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978261120 00000100:00100000:2.0:1790919651.742783:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919651.742788:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978261120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919651.742828:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919651.742862:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978261120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919651.742868:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919651.742895:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978261120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919651.742918:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978260864:0@lo:400:kworker.0 00000100:00100000:1.0:1790919651.743172:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978261248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919651.743201:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919651.743542:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919641/real 1790919641] req@ffff95f2860ffb80 x1877914978254464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919651.743560:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f2860ffb80 x1877914978254464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919651.743572:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919641/real 1790919641] req@ffff95f382e27b80 x1877914978254336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919651.743581:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f382e27b80 x1877914978254336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790919651.743609:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919651.743621:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919651.743625:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978254464:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790919651.743630:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919651.743634:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919651.743637:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978254336:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1790919651.746695:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978261248 00000100:00100000:2.0:1790919651.746708:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978261248 00000100:00100000:2.0:1790919651.746755:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790919651.746765:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978261248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919651.746810:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919651.746971:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260480 00000100:00100000:3.0:1790919651.746976:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260480 00000100:00100000:3.0:1790919651.747009:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919651.747016:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:3458:x1877914978260480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919651.747091:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:3458:x1877914978260480:12345-0@lo:400:kworker.0 Request processed in 75us (4878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919651.747098:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919651.747132:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260992 00000100:00100000:3.0:1790919651.747135:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260992 00000100:00100000:3.0:1790919651.747158:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978260736 00000100:00100000:3.0:1790919651.747162:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978260736 00000100:00100000:3.0:1790919651.747176:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919651.747181:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978260992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919651.747214:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978260992:12345-0@lo:400:kworker.0 Request processed in 32us (4949us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919651.747220:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919651.747231:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790919651.747236:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978260736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919651.747268:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978260736:12345-0@lo:400:kworker.0 Request processed in 31us (4877us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919651.747274:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919651.748718:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3461:x1877914978261248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1949us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919651.748730:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790919651.748784:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f382e24a80 x1877914978260736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919651.748799:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978260736:0@lo:400:kworker.0 00000100:00100000:2.0:1790919651.748836:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978260480:0@lo:400:kworker.0 00010000:00080000:2.0:1790919651.748849:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f3b606b480 x1877914978260992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919651.748859:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978260992:0@lo:400:kworker.0 00000100:00080000:2.0:1790919651.748881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.748886:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919651.748896:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.748899:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919651.748903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.748906:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790919651.748909:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919651.748914:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1790919651.748918:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919651.748927:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f392712000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919651.748956:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b606b480 x1877914978261376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919651.748981:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919651.748984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790919651.748985:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919651.748988:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1790919651.748990:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790919651.748995:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f387168800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919651.749007:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b6069880 x1877914978261504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919651.749234:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978261376:0@lo:8:kworker.0 00000400:00000100:3.0:1790919651.749277:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978261376 offset 0 length 520: 4 00000100:00100000:3.0:1790919651.749303:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978261504:0@lo:8:kworker.0 00000400:00000100:3.0:1790919651.749322:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978261504 offset 0 length 520: 4 00000100:00100000:1.0:1790919651.750699:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978261248:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1790919651.794962:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790919652.000668:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919652.317084:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1790919652.651853:0:17710:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790919652.651857:0:17710:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790919652.651960:0:17710:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f385574800 00000020:01000004:2.0:1790919652.651976:0:17710:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790919652.651993:0:17710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790919652.652006:0:17710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95f3bdfe19c0) 00000020:00000080:2.0:1790919652.652024:0:17710:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790919652.664666:0:17710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790919652.664935:0:17710:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790919652.665686:0:17710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790919652.665913:0:17710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790919652.666216:0:17710:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790919652.666545:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 373: rc = 0 00100000:10000000:2.0:1790919652.666648:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 373: rc = 0 00100000:10000000:2.0:1790919652.666739:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 373: rc = 0 00100000:10000000:2.0:1790919652.667199:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1790919652.667449:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1790919652.667791:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1790919652.668030:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1790919652.668356:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1790919652.668592:0:17710:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00000020:00000080:2.0:1790919652.669152:0:17710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790919652.669164:0:17710:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790919652.669174:0:17710:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x951c50ad159148dc 00000020:01000004:2.0:1790919652.669182:0:17710:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790919652.669203:0:17710:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790919652.669207:0:17710:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790919652.669212:0:17710:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790919652.669217:0:17710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790919652.669228:0:17710:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95f3bdfe4d40) 00000020:00000080:2.0:1790919652.669239:0:17710:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790919652.670358:0:17710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919652.670512:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790919652.670518:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790919652.671502:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790919652.671511:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790919652.677037:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790919652.677142:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790919652.679769:0:17710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919652.679955:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790919652.679961:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790919652.680748:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790919652.680757:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790919652.698432:0:17710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919652.698756:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790919652.698763:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790919652.700049:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790919652.700118:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790919652.702246:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790919652.702255:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790919652.704809:0:17710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919652.705009:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790919652.705015:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790919652.705910:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790919652.705918:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790919652.742251:0:17710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919652.742543:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790919652.742550:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790919652.746372:0:17710:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790919652.746385:0:17710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790919652.747414:0:17710:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790919652.747438:0:17710:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790919652.747445:0:17710:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790919652.758204:0:17710:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790919652.758238:0:17710:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790919652.758242:0:17710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790919652.758244:0:17710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919652.758245:0:17710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919652.758247:0:17710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919652.758248:0:17710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919652.758249:0:17710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919652.758250:0:17710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919652.758252:0:17710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919652.758253:0:17710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919652.758256:0:17710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790919652.758258:0:17710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919652.758260:0:17710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919652.758261:0:17710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919652.758262:0:17710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919652.758263:0:17710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919652.758264:0:17710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919652.758265:0:17710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919652.758266:0:17710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919652.758267:0:17710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919652.758299:0:17710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790919652.758318:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978261632:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919652.758378:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.758422:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919652.758629:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978261632 00000100:00100000:0.0:1790919652.758638:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978261632 00000100:00100000:0.0:1790919652.758691:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919652.758701:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17710:x1877914978261632:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919652.758731:0:16401:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790919652.758734:0:16401:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790919652.758738:0:16401:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790919652.776276:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17710:x1877914978261632:12345-0@lo:253:mount.lustre.0 Request processed in 17568us (17888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.776291:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790919652.776375:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978261632:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919652.776539:0:17710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790919652.776542:0:17710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919652.776544:0:17710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919652.776545:0:17710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919652.776547:0:17710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919652.776548:0:17710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919652.776550:0:17710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919652.776551:0:17710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919652.776553:0:17710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919652.776555:0:17710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790919652.776575:0:17710:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f385574800 from lustre-OST0000 10000000:01000000:2.0:1790919652.776613:0:17710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790919652.776616:0:17710:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790919652.776624:0:17710:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f3a68bcd40 local copy 00010000:00010000:2.0:1790919652.776634:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.776854:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978261760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919652.776891:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.776993:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919652.777155:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978261760 00000100:00100000:3.0:1790919652.777161:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978261760 00000100:00100000:3.0:1790919652.777246:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790919652.777255:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17710:x1877914978261760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919652.777442:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17710:x1877914978261760:12345-0@lo:501:mount.lustre.0 Request processed in 188us (549us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919652.777449:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790919652.777510:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978261760:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790919652.777524:0:17710:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790919652.777676:0:17710:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790919652.777683:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.777693:0:17710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919652.777714:0:17710:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f385574800 10000000:01000000:2.0:1790919652.777724:0:17710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790919652.777729:0:17710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790919652.777732:0:17710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790919652.777736:0:17710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790919652.777739:0:17710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790919652.777762:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.777769:0:17710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.777777:0:17710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.777790:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978261888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919652.777820:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.778226:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919652.778303:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978261888 00000100:00100000:0.0:1790919652.778309:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978261888 00000100:00100000:0.0:1790919652.778342:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919652.778349:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+18:17710:x1877914978261888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919652.778360:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919652.778372:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015000/0x951c50ad159148f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159148ea expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.778457:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015000/0x951c50ad159148f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159148ea expref: 19 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.778468:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015000/0x951c50ad159148f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159148ea expref: 19 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.778476:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015000, rc 0) 00000100:00100000:0.0:1790919652.778556:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978261888:12345-0@lo:101:mount.lustre.0 Request processed in 207us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.778564:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919652.778700:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978261888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919652.778713:0:17710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.778721:0:17710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919652.779536:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790919652.780607:0:17710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919652.780850:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790919652.783559:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790919652.783661:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790919652.783737:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790919652.783792:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790919652.783827:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790919652.783907:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790919652.783915:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790919652.784022:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919652.784102:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.784149:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919652.784368:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262016 00000100:00100000:3.0:1790919652.784394:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262016 00000100:00100000:3.0:1790919652.784437:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790919652.784445:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919652.784899:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262016:12345-0@lo:501:mount.lustre.0 Request processed in 454us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.784907:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790919652.786212:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919652.786269:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919652.786335:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.786490:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919652.788345:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262144 00000100:00100000:1.0:1790919652.788357:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262144 00000100:00100000:1.0:1790919652.788596:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790919652.788606:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919652.789164:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262144:12345-0@lo:503:mount.lustre.0 Request processed in 558us (2827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919652.789172:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790919652.789445:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919652.790815:0:17710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919652.790973:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.791528:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.791636:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919652.791680:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262272 00000100:00100000:0.0:1790919652.791693:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262272 00000100:00100000:0.0:1790919652.791769:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919652.791777:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919652.792167:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262272:12345-0@lo:502:mount.lustre.0 Request processed in 389us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.792174:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790919652.792284:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919652.792539:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790919652.792597:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790919652.792634:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790919652.792681:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790919652.792731:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790919652.792764:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790919652.792824:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790919652.792863:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790919652.792912:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790919652.792958:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790919652.793288:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790919652.793355:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1790919652.793448:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919652.793496:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.793691:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919652.793780:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262400 00000100:00100000:3.0:1790919652.793788:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262400 00000100:00100000:3.0:1790919652.793821:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919652.793828:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.794079:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262400:12345-0@lo:502:mount.lustre.0 Request processed in 250us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.794086:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790919652.794200:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919652.794265:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1790919652.794274:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1790919652.795350:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790919652.795360:0:17724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790919652.795367:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.795369:0:17724:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790919652.795375:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919652.795466:0:17724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95f284f4cd40) 00000020:00000080:2.0:1790919652.795490:0:17724:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790919652.795497:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790919652.795557:0:17724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f385574800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790919652.795564:0:17724:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919652.795572:0:17724:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x951c50ad159148ff 00010000:00010000:2.0:1790919652.799463:0:17724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1790919652.799895:0:17724:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1790919652.801771:0:17724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790919652.803164:0:17724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790919652.803177:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.803182:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.803184:0:17724:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790919652.803188:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790919652.803191:0:17724:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1790919652.803192:0:17724:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919652.803194:0:17724:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919652.803195:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790919652.803198:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.803200:0:17724:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790919652.803210:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919652.803214:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.803215:0:17724:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790919652.803218:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790919652.803221:0:17724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790919652.803223:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.803225:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.803226:0:17724:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790919652.803229:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919652.803231:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.803232:0:17724:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790919652.803235:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790919652.803285:0:17724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.803288:0:17724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.803290:0:17724:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790919652.803294:0:17724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1790919652.803528:0:17710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1790919652.803556:0:17710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790919652.803574:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919652.803597:0:17710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919652.803614:0:17710:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385574800 from 1 10000000:01000000:1.0:1790919652.803617:0:17710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919652.803649:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919652.803657:0:17710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919652.803667:0:17710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919652.803690:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919652.803774:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919652.803824:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.804217:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262528 00000100:00100000:2.0:1790919652.804225:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262528 00000100:00100000:2.0:1790919652.804273:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919652.804283:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978262528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919652.804296:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919652.804308:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914906 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.804331:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914906 expref: 20 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.804341:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914906 expref: 20 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.804349:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee400, rc 0) 00000100:00100000:2.0:1790919652.804503:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262528:12345-0@lo:101:mount.lustre.0 Request processed in 220us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.804518:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790919652.804606:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919652.804620:0:17710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919652.804628:0:17710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919652.805131:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790919652.805862:0:17710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919652.806250:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790919652.806299:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790919652.806356:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790919652.806363:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790919652.807631:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919652.807693:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919652.807740:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.808099:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262656 00000100:00100000:2.0:1790919652.808107:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262656 00000100:00100000:2.0:1790919652.808146:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790919652.808155:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919652.808418:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262656:12345-0@lo:501:mount.lustre.0 Request processed in 263us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.808426:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790919652.808571:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919652.808614:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919652.808655:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919652.808682:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.809083:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262784 00000100:00100000:2.0:1790919652.809089:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262784 00000100:00100000:2.0:1790919652.809112:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919652.809118:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919652.809270:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262784:12345-0@lo:503:mount.lustre.0 Request processed in 150us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.809277:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919652.809597:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790919652.810686:0:17710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919652.810759:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.810822:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.810863:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919652.810964:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978262912 00000100:00100000:0.0:1790919652.810971:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978262912 00000100:00100000:0.0:1790919652.811097:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919652.811103:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919652.811282:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978262912:12345-0@lo:502:mount.lustre.0 Request processed in 178us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.811290:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790919652.811536:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978262912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919652.811784:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790919652.811832:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790919652.811883:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790919652.811916:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790919652.811945:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790919652.812198:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790919652.812249:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790919652.812285:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1790919652.812334:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790919652.812371:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1790919652.812480:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1790919652.812515:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.812568:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.812645:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.812682:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263040 00000100:00100000:2.0:1790919652.812688:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263040 00000100:00100000:2.0:1790919652.812757:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790919652.812766:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978263040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919652.812954:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978263040:12345-0@lo:502:mount.lustre.0 Request processed in 189us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.812961:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790919652.813045:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919652.813146:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1790919652.813156:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790919652.817374:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919652.817459:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.817462:0:17728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790919652.817470:0:17728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f385574800 00000020:00000080:2.0:1790919652.817484:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919652.817491:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.817493:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.817495:0:17728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790919652.817497:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919652.817499:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.817501:0:17728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790919652.817503:0:17728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f385574800 00000020:00000080:2.0:1790919652.817505:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919652.817602:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.817607:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.817608:0:17728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790919652.817610:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919652.817613:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.817614:0:17728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919652.817618:0:17728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f385574800 00000020:00000080:2.0:1790919652.817620:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919652.821096:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.821118:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.821120:0:17728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919652.821125:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919652.821129:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.821131:0:17728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790919652.821136:0:17728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f385574800 00000020:00000080:2.0:1790919652.821137:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919652.821232:0:17728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919652.821235:0:17728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919652.821237:0:17728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790919652.821240:0:17728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790919652.826682:0:17710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790919652.826730:0:17710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919652.826757:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919652.826770:0:17710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919652.826819:0:17710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919652.826822:0:17710:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f385574800 10000000:01000000:3.0:1790919652.826825:0:17710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f385574800 10000000:01000000:3.0:1790919652.826828:0:17710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919652.826833:0:17710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f385574800 from 1 10000000:01000000:3.0:1790919652.826836:0:17710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919652.826870:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919652.826879:0:17710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919652.826901:0:17710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919652.826925:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919652.827326:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.827510:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.827551:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263168 00000100:00100000:2.0:1790919652.827558:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263168 00000100:00100000:2.0:1790919652.827642:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790919652.827652:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:17710:x1877914978263168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919652.827684:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919652.827696:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860efc00/0x951c50ad1591491b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914914 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.827721:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860efc00/0x951c50ad1591491b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914914 expref: 21 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.827731:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860efc00/0x951c50ad1591491b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914914 expref: 21 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.827740:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860efc00, rc 0) 00000100:00100000:2.0:1790919652.827782:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263168:12345-0@lo:101:mount.lustre.0 Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.827789:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919652.827854:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919652.827871:0:17710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919652.827881:0:17710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919652.828819:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790919652.829564:0:17710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919652.829790:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790919652.829839:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790919652.829863:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790919652.829897:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790919652.829922:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790919652.829955:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790919652.830180:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790919652.830224:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790919652.830275:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790919652.831151:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790919652.831208:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790919652.831268:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790919652.831306:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790919652.831341:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790919652.831539:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790919652.831576:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790919652.831625:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790919652.831693:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790919652.831727:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790919652.831760:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790919652.831807:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790919652.831844:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790919652.831878:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790919652.831928:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790919652.831964:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1790919652.833184:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1790919652.833260:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1790919652.833295:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1790919652.833326:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1790919652.833716:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1790919652.833758:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1790919652.833793:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1790919652.833825:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1790919652.833891:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1790919652.833929:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1790919652.834492:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1790919652.834546:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1790919652.834658:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1790919652.834667:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790919652.834781:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919652.834846:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.834897:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.835046:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263296 00000100:00100000:2.0:1790919652.835131:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263296 00000100:00100000:2.0:1790919652.835179:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919652.835188:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919652.835536:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263296:12345-0@lo:501:mount.lustre.0 Request processed in 348us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.835544:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790919652.837613:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919652.837683:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919652.837777:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.837822:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919652.837833:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263424 00000100:00100000:2.0:1790919652.837841:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263424 00000100:00100000:2.0:1790919652.837888:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790919652.837897:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919652.838274:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263424:12345-0@lo:503:mount.lustre.0 Request processed in 377us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.838291:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790919652.838371:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263424:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790919652.839043:0:17710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919652.839188:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.839750:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.839795:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919652.839824:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263552 00000100:00100000:0.0:1790919652.839831:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263552 00000100:00100000:0.0:1790919652.839876:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790919652.839884:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919652.842825:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263552:12345-0@lo:502:mount.lustre.0 Request processed in 2934us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.842838:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790919652.843460:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919652.843765:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790919652.843819:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790919652.843851:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790919652.843895:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790919652.843929:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790919652.843972:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790919652.844004:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790919652.844036:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790919652.844131:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790919652.844168:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790919652.844199:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790919652.844254:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790919652.844292:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790919652.844326:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790919652.844379:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790919652.844421:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790919652.844470:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790919652.844529:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790919652.844604:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790919652.847169:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790919652.847298:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790919652.847354:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790919652.847391:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790919652.847442:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790919652.847632:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1790919652.847674:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1790919652.847742:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1790919652.847784:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1790919652.847873:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1790919652.847926:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1790919652.847960:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1790919652.847991:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1790919652.848027:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1790919652.848174:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1790919652.848222:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1790919652.848333:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1790919652.848383:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1790919652.848431:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1790919652.848569:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1790919652.848661:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1790919652.848719:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1790919652.848758:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1790919652.848806:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1790919652.848845:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1790919652.848892:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1790919652.848950:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1790919652.848993:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1790919652.849043:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1790919652.849148:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.849229:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.849287:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919652.850118:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263680 00000100:00100000:3.0:1790919652.850128:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263680 00000100:00100000:3.0:1790919652.850182:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790919652.850189:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.850684:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263680:12345-0@lo:502:mount.lustre.0 Request processed in 493us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.850693:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790919652.850759:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919652.850881:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1790919652.850924:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1790919652.850958:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919652.851000:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.851018:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919652.852196:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263808 00000100:00100000:0.0:1790919652.852208:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263808 00000100:00100000:0.0:1790919652.852268:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790919652.852277:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919652.852491:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978263808:12345-0@lo:502:mount.lustre.0 Request processed in 214us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.852509:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919652.853341:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978263808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919652.853492:0:17710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1790919652.853510:0:17710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790919652.857573:0:17733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790919652.857604:0:17733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95f3908a99c0) 00000020:00000080:3.0:1790919652.857627:0:17733:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1790919652.857724:0:17733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f385574800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790919652.857728:0:17733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f385574800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790919652.857731:0:17733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385574800 3 00010000:00080000:3.0:1790919652.857758:0:17733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f392715800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919652.862021:0:17733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1790919652.862242:0:17733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790919652.862279:0:17733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790919652.862303:0:17733:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x951c50ad15914929 00000100:00080000:3.0:1790919652.862313:0:17733:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919652.862324:0:17733:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f392715800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919652.862362:0:17733:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fdf80 x1877914978263936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919652.862393:0:17733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919652.862436:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.862441:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919652.862443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.862446:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919652.862470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.862472:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919652.862475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.862478:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790919652.862485:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978263936:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790919652.862518:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978264064:0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.862564:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.862566:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.863719:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919652.863731:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978264192:0@lo:400:kworker.0 00000100:00100000:1.0:1790919652.864099:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978264448:0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.867280:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.867470:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978264320:0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.867508:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919652.867553:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264064 00000100:00100000:3.0:1790919652.867561:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264064 00000100:00100000:3.0:1790919652.867607:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264320 00000100:00100000:3.0:1790919652.867610:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264320 00000100:00100000:3.0:1790919652.867637:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919652.867647:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978264064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.867721:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978264064:12345-0@lo:400:kworker.0 Request processed in 75us (5159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.867734:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919652.867751:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919652.867757:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978264320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.867793:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978264320:12345-0@lo:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.867799:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919652.867834:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978263936 00000100:00100000:3.0:1790919652.867838:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978263936 00000100:00100000:3.0:1790919652.867856:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264192 00000100:00100000:3.0:1790919652.867858:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264192 00000100:00100000:3.0:1790919652.867873:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919652.867879:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.867911:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978264192:12345-0@lo:400:kworker.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.867917:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919652.867928:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919652.867932:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978263936:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790919652.867954:0:16408:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:3.0:1790919652.867987:0:16408:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x951c50ad15914930 00000004:00100000:3.0:1790919652.868013:0:16408:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790919652.868045:0:16408:0:(import.c:65:import_set_state_nolock()) ffff95f285da0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919652.868101:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1877914978263936:12345-0@lo:38:llog_process_th.0 Request processed in 167us (5540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.868108:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919652.868238:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978264320:0@lo:400:kworker.0 00010000:00080000:3.0:1790919652.868279:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f2860fdc00 x1877914978264192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919652.868290:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978264192:0@lo:400:kworker.0 00000100:00100000:3.0:1790919652.868301:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978264064:0@lo:400:kworker.0 00000100:00100000:1.0:1790919652.870533:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919652.870592:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264448 00000100:00100000:1.0:1790919652.870601:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264448 00000100:00100000:1.0:1790919652.870647:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919652.870657:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978264448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919652.870724:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978264448:12345-0@lo:400:kworker.0 Request processed in 70us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919652.870732:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790919652.870777:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f2860fd880 x1877914978264448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919652.870790:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978264448:0@lo:400:kworker.0 00000020:01000004:3.0:1790919652.871203:0:17733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790919652.871228:0:17733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff95f285d899c0) 00000020:00000080:3.0:1790919652.871250:0:17733:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1790919652.871322:0:17733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f385574800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790919652.871326:0:17733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f385574800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790919652.871328:0:17733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385574800 3 00010000:00080000:3.0:1790919652.871354:0:17733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f285da2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00080000:2.0:1790919652.872114:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f2860fdf80 x1877914978263936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919652.872126:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919652.872135:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790919652.872146:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790919652.872149:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790919652.872153:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790919652.872159:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978263936:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1790919652.873028:0:17733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1790919652.873214:0:17733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790919652.873247:0:17733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790919652.873256:0:17733:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x951c50ad1591493e 00000100:00080000:3.0:1790919652.873262:0:17733:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919652.873271:0:17733:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff95f285da2800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919652.873300:0:17733:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860ff480 x1877914978264576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919652.873323:0:17733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790919652.874141:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1790919652.874141:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978264576:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790919652.874146:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919652.874148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.874151:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919652.874162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.874165:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919652.874167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919652.874170:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790919652.874199:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.874256:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264576 00000100:00100000:2.0:1790919652.874263:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264576 00000100:00100000:2.0:1790919652.874297:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919652.874303:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978264576:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790919652.874330:0:16407:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1790919652.874361:0:16407:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x951c50ad15914945 00000004:00100000:2.0:1790919652.874376:0:16407:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790919652.874403:0:16407:0:(import.c:65:import_set_state_nolock()) ffff95f283a02800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919652.874450:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1877914978264576:12345-0@lo:38:llog_process_th.0 Request processed in 146us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919652.874457:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790919652.874495:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f2860ff480 x1877914978264576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919652.874503:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919652.874509:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790919652.874515:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790919652.874518:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790919652.874520:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f285da2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790919652.874525:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978264576:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790919652.874549:0:17733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1790919652.875166:0:17710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790919652.875200:0:17710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790919652.875220:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.875231:0:17710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790919652.875284:0:17710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790919652.875286:0:17710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919652.875365:0:17710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919652.875367:0:17710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919652.875369:0:17710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919652.875370:0:17710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919652.875372:0:17710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919652.875374:0:17710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919652.875375:0:17710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790919652.875378:0:17710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790919652.875381:0:17710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919652.875382:0:17710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919652.875384:0:17710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919652.875385:0:17710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919652.875386:0:17710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919652.875388:0:17710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919652.875394:0:17710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919652.875395:0:17710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919652.875396:0:17710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790919652.875414:0:17710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790919652.875428:0:17710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978264704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919652.875483:0:17710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919652.875549:0:17710:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285875c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919652.875596:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264704 00000100:00100000:3.0:1790919652.875602:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264704 00000100:00100000:3.0:1790919652.875675:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790919652.875685:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:17710:x1877914978264704:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790919652.875708:0:16400:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790919652.875723:0:16400:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790919652.903547:0:16400:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790919652.903560:0:16400:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790919652.903663:0:16422:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790919652.903668:0:16422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790919652.903689:0:16422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.903708:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591488f expref: 21 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.903716:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591489d expref: 21 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.903724:0:16422:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.903765:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591489d expref: 21 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.903781:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591489d expref: 21 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.903797:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978264832:0@lo:104: 00000100:00100000:2.0:1790919652.903864:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919652.903920:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591488f expref: 21 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.903950:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591488f expref: 21 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.903960:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978264960:0@lo:104: 00000100:00100000:3.0:1790919652.904114:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264832 00000100:00100000:3.0:1790919652.904122:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264832 00000100:00100000:3.0:1790919652.904181:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919652.904191:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978264832:12345-0@lo:104: 00010000:00010000:3.0:1790919652.904204:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.904651:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919652.904741:0:16389:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1790919652.904945:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919652.904952:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978264832:12345-0@lo:104: Request processed in 763us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.904960:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919652.904988:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978264960 00000100:00100000:3.0:1790919652.904993:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978264960 00010000:00010000:0.0:1790919652.905093:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919652.905102:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905110:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919652.905115:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905124:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919652.905131:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919652.905137:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919652.905170:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905177:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919652.905196:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905203:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ef600/0x951c50ad1591489d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148a4 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905216:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919652.905218:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919652.905220:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919652.905239:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978265088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919652.905286:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919652.905337:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265088 00000100:00100000:0.0:1790919652.905341:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265088 00010000:00010000:0.0:1790919652.905368:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591489d expref: 22 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919652.905391:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919652.905399:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3458:x1877914978265088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919652.905410:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919652.905415:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591489d expref: 22 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905425:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591489d expref: 22 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905439:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919652.905468:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3458:x1877914978265088:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.905475:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919652.905508:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978265088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919652.905769:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919652.905783:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285865050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978264960:12345-0@lo:104: 00010000:00010000:3.0:1790919652.905792:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919652.905836:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919652.905841:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285865050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978264960:12345-0@lo:104: Request processed in 60us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.905847:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790919652.905918:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919652.905924:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905931:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919652.905934:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.905941:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919652.905952:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919652.905958:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919652.906124:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906132:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919652.906146:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906153:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015200/0x951c50ad1591488f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914896 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906167:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919652.906168:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919652.906169:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919652.906179:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978265216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919652.906211:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919652.906245:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265216 00000100:00100000:0.0:1790919652.906250:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265216 00010000:00010000:0.0:1790919652.906265:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591488f expref: 22 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919652.906284:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919652.906290:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeb27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3459:x1877914978265216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919652.906298:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919652.906302:0:16393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591488f expref: 22 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906318:0:16393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591488f expref: 22 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906331:0:16393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906338:0:16393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919652.906353:0:16393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003852935s 00010000:00010000:0.0:1790919652.906357:0:16393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906365:0:16393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906371:0:16393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906377:0:16393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906382:0:16393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919652.906386:0:16393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906392:0:16393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906400:0:16393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919652.906416:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919652.906447:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeb27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3459:x1877914978265216:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919652.906453:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919652.906500:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978265216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919652.906760:0:16422:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815b40 going to sleep for 11 seconds 00010000:00010000:2.0:1790919652.906776:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014800/0x951c50ad159148a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591489d expref: 21 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.906786:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978264832:0@lo:104: 00010000:00010000:2.0:1790919652.906796:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee800/0x951c50ad15914896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591488f expref: 20 pid: 16401 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919652.906804:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978264960:0@lo:104: 00010000:00010000:2.0:1790919652.906822:0:16422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.906831:0:16422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.906838:0:16422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919652.906844:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee200/0x951c50ad1591494c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919652.916532:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:17710:x1877914978264704:12345-0@lo:253:mount.lustre.0 Request processed in 40840us (41038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919652.916548:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790919652.916636:0:17710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:17710:1877914978264704:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919652.916723:0:17710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790919652.916737:0:17710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919652.916739:0:17710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919652.916740:0:17710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919652.916741:0:17710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919652.916743:0:17710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919652.916744:0:17710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919652.916746:0:17710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919652.916747:0:17710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919652.916748:0:17710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790919652.916766:0:17710:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919652.917362:0:17710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919652.917530:0:17710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919652.917778:0:17710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919652.917925:0:17710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919652.918459:0:17710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919652.918757:0:17710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790919652.919625:0:17710:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1790919652.974419:0:17710:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790919652.974428:0:17710:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790919652.974462:0:17710:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790919652.974524:0:17710:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790919652.974540:0:17710:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790919652.974567:0:17710:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790919653.021015:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919653.534318:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790919654.044299:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790919654.109322:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790919654.109330:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f391982800 from 9 10000000:01000000:0.0:1790919654.109335:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919654.109383:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919654.109396:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919654.109407:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919654.109430:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919654.109499:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919654.109546:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f387fc4780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919654.109627:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265344 00000100:00100000:2.0:1790919654.109636:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265344 00000100:00100000:2.0:1790919654.109690:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790919654.109701:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:16403:x1877914978265344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919654.109716:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919654.109729:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914953 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.109753:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914953 expref: 20 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.109764:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914953 expref: 20 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.109795:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef800, rc 0) 00000100:00100000:2.0:1790919654.109845:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:16403:x1877914978265344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919654.109852:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790919654.109898:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919654.110272:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.110283:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919654.110356:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919654.110389:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919654.110675:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919654.110699:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265472 00000100:00100000:0.0:1790919654.110706:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265472 00000100:00100000:0.0:1790919654.110751:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790919654.110761:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:16403:x1877914978265472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790919654.110779:0:16400:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919654.110797:0:16400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919654.110800:0:16400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1790919654.110895:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:16403:x1877914978265472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919654.110903:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790919654.110906:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 10000000:01000000:2.0:1790919654.110980:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919654.110986:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.110995:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919654.111004:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919654.111006:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3aee80800 from 9 10000000:01000000:2.0:1790919654.111008:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919654.111027:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.111040:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.111048:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919654.111081:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919654.111221:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919654.111254:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919654.111256:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265600 00000100:00100000:0.0:1790919654.111263:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265600 00000100:00100000:0.0:1790919654.111293:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790919654.111300:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:16403:x1877914978265600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919654.111310:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919654.111321:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914961 expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919654.111338:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914961 expref: 21 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919654.111347:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914961 expref: 21 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919654.111353:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015a00, rc 0) 00000100:00100000:0.0:1790919654.111385:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978265600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919654.111392:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919654.111485:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919654.111498:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.111506:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919654.111550:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919654.111888:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919654.111970:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919654.112208:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265728 00000100:00100000:0.0:1790919654.112214:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265728 00000100:00100000:0.0:1790919654.112251:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790919654.112266:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978265728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790919654.112281:0:16400:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919654.112293:0:16400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919654.112296:0:16400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1790919654.112368:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978265728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919654.112376:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919654.112522:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978265728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790919654.113093:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919654.113102:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919654.113321:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919655.069696:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919655.964202:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919640/real 1790919640] req@ffff95f382e26680 x1877914978252800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919655.964235:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f382e26680 x1877914978252800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919655.964246:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919640/real 1790919640] req@ffff95f382e26d80 x1877914978252928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919655.964257:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f382e26d80 x1877914978252928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790919655.964277:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919655.964302:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790919655.964306:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252800:0@lo:8:kworker.0 00000100:00080000:2.0:1790919655.964312:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919655.964316:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790919655.964319:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978252928:0@lo:8:kworker.0 00000100:00080000:1.0:1790919655.964454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919655.964459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790919655.964462:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919655.964466:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:1.0:1790919655.964471:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790919655.964481:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f3b58c0000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919655.964499:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f38d548700 x1877914978266112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919655.964511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919655.964513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919655.964515:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919655.964518:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:1.0:1790919655.964520:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790919655.964524:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f383f4b800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919655.964533:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f38d548000 x1877914978266240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919655.964571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919655.964587:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919655.964589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919655.964592:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790919655.964641:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978265984:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964698:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964727:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978266752:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964754:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964773:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790919655.964779:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978265856:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964804:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964827:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978266624:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964849:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964870:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978266496:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964892:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964910:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790919655.964915:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978266368:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964938:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964952:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978266880:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.964974:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.964996:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265984 00000100:00100000:1.0:1790919655.965003:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265984 00000100:00100000:1.0:1790919655.965036:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266496 00000100:00100000:1.0:1790919655.965039:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266496 00000100:00100000:1.0:1790919655.965082:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919655.965092:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965152:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978265984:12345-0@lo:400:kworker.0 Request processed in 61us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919655.965160:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919655.965175:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919655.965181:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978266496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965212:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978266496:12345-0@lo:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919655.965218:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919655.965236:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266752 00000100:00100000:1.0:1790919655.965239:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266752 00000100:00100000:1.0:1790919655.965264:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266624 00000100:00100000:1.0:1790919655.965266:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266624 00000100:00100000:1.0:1790919655.965274:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266368 00000100:00100000:1.0:1790919655.965276:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266368 00000100:00100000:1.0:1790919655.965284:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266880 00000100:00100000:1.0:1790919655.965286:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266880 00000100:00100000:1.0:1790919655.965297:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919655.965302:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978266752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965328:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978266752:12345-0@lo:400:kworker.0 Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919655.965333:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919655.965342:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919655.965346:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978266624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965368:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978266624:12345-0@lo:400:kworker.0 Request processed in 21us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919655.965372:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919655.965379:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919655.965391:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978266368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965414:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978266368:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919655.965418:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919655.965427:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919655.965431:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978266880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965450:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978266880:12345-0@lo:400:kworker.0 Request processed in 18us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919655.965454:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1790919655.965483:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d54a300 x1877914978266368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919655.965494:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978266368:0@lo:400:kworker.0 00010000:00080000:1.0:1790919655.965502:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d548a80 x1877914978266880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919655.965510:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978266880:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965517:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978266496:0@lo:400:kworker.0 00010000:00080000:1.0:1790919655.965541:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d549180 x1877914978266624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919655.965549:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978266624:0@lo:400:kworker.0 00000100:00100000:1.0:1790919655.965569:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978265984:0@lo:400:kworker.0 00010000:00080000:1.0:1790919655.965578:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d54b100 x1877914978266752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919655.965585:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978266752:0@lo:400:kworker.0 00000100:00080000:0.0:1790919655.966232:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919655.966238:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919655.966356:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978265856 00000100:00100000:2.0:1790919655.966362:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978265856 00000100:00100000:2.0:1790919655.966391:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919655.966398:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3461:x1877914978265856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919655.966459:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3461:x1877914978265856:12345-0@lo:400:kworker.0 Request processed in 61us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919655.966465:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790919655.966501:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978266112:0@lo:8:kworker.0 00000100:00100000:2.0:1790919655.966536:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919655.966573:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978266240:0@lo:8:kworker.0 00000100:00100000:2.0:1790919655.966592:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919655.966784:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266112 00000100:00100000:0.0:1790919655.966788:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266112 00000100:00100000:0.0:1790919655.966809:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978266240 00000100:00100000:0.0:1790919655.966812:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978266240 00000100:00100000:0.0:1790919655.966821:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919655.966826:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978266112:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790919655.966851:0:17711:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1790919655.966875:0:17711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591496f 00002000:00100000:0.0:1790919655.966887:0:17711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95f284291800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790919655.966891:0:17711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790919655.966894:0:17711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790919655.967329:0:17711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919655.967352:0:17711:0:(import.c:65:import_set_state_nolock()) ffff95f284295000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919655.967401:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978266112:12345-0@lo:8:kworker.0 Request processed in 573us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919655.967407:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919655.967422:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919655.967426:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978266240:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790919655.967447:0:17711:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1790919655.967958:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f38d548700 x1877914978266112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919655.967969:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919655.967976:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790919655.967984:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919655.967988:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790919655.967991:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790919655.968003:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978265856:0@lo:400:kworker.0 00000004:00080000:1.0:1790919655.968004:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919655.968008:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978266112:0@lo:8:kworker.0 00000004:00080000:3.0:1790919655.968027:0:16430:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790919655.968071:0:16431:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1790919655.968090:0:16431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16431:1877914978267136:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790919655.968123:0:16431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919655.968141:0:16431:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a686ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919655.968157:0:17712:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790919655.968163:0:17712:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790919655.968178:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978267008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919655.968200:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1790919655.968427:0:16430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 464996373596ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790919655.968525:0:17714:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790919655.968536:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267136 00000100:00100000:2.0:1790919655.968540:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267136 00000100:00100000:2.0:1790919655.968596:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267008 00000100:00100000:2.0:1790919655.968599:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267008 00000100:00100000:2.0:1790919655.968617:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919655.968625:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3459:x1877914978267008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919655.968652:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919655.968693:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3459:x1877914978267008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919655.968700:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790919655.968728:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285aab800 x1877914978267008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919655.968741:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978267008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790919655.968928:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919655.985898:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919655.985938:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16431:x1877914978267136:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790919655.986933:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978266240:12345-0@lo:8:kworker.0 Request processed in 19501us (20336us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790919655.986943:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790919655.987005:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919655.987011:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790919655.987015:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978266240:0@lo:8:kworker.0 00002000:00080000:3.0:1790919656.001835:0:17918:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1790919656.001850:0:17918:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790919656.001856:0:17918:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:3.0:1790919656.016474:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.016485:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.016503:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.016508:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.016514:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.016545:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.016554:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.016576:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.016688:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919656.017248:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.017255:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.017265:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.017269:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.017274:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.017284:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.017292:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.017311:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.020995:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919656.021009:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021023:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ca00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.021028:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021046:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021084:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021092:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee5aa2d/0x951c50ad15914976 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021118:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919656.021122:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021128:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166da00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.021131:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021138:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021148:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.021156:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.021159:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.021169:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.021571:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919656.021579:0:17918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a02cf3ee/0x951c50ad1591497d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.022188:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.022692:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.022701:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.022715:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.022719:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.022725:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.022738:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.022746:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.022752:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.022783:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919656.022991:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919656.022997:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.023005:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.023009:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.023018:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.023032:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.023039:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b414bd3f/0x951c50ad15914984 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.023074:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.023077:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.023078:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.023405:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.023411:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.023422:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.023425:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.023430:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.023439:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.023446:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.023454:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.023707:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919656.024135:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.024141:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024150:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.024159:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.024164:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024174:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024182:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024188:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024203:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790919656.024212:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919656.024216:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024223:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.024227:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024235:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024246:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024264:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad1591498b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024279:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.024282:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024288:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.024291:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024299:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024307:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024314:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad15914992 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024323:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.024325:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.024326:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.024821:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.024827:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024841:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.024845:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.024849:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024858:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024866:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024873:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.024887:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.024894:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.024897:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.025547:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.028244:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.028252:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.028269:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.028307:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.028315:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad15914999 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.028345:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.028347:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.028350:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.032067:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.032083:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.032100:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.032104:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.032110:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.032123:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.032133:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.032141:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.032175:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919656.032473:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919656.032481:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.032542:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919656.032547:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.032569:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.032589:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.032596:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000462bb84a/0x951c50ad159149a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919656.032817:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919656.032820:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919656.032822:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.033343:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.033351:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033363:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.033367:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.033372:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033384:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033392:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033400:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033416:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.033425:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.033430:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033436:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.033447:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033455:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033466:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033472:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009444514c/0x951c50ad159149a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.033486:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.033488:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.033489:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.034134:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.034141:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034151:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.034155:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.034160:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034170:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034180:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034193:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034210:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.034221:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.034225:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034233:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.034237:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034245:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034257:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034264:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad159149ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.034282:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.034284:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.034285:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.035185:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.035202:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035215:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.035218:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.035223:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035233:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035240:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035248:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035263:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.035272:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.035276:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035282:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.035286:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035293:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035312:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035319:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad159149b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.035337:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.035339:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.035341:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.036146:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.036155:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036166:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.036169:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.036173:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036183:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036191:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036198:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036226:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.036236:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.036240:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036248:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380031a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.036252:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036260:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036273:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036280:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004266e104/0x951c50ad159149bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.036297:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.036299:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.036301:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.038280:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.038293:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038308:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.038319:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.038325:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038338:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038347:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038355:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038372:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.038383:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.038388:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038395:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.038400:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038409:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038423:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038441:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077c67a10/0x951c50ad159149c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.038460:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.038462:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.038464:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.039808:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.039817:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039830:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.039833:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.039838:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039849:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039857:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039865:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039882:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919656.039894:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919656.039919:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039926:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919656.039931:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.039940:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.040841:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.040857:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb7a2ac7/0x951c50ad159149ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.040876:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.040878:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.040880:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.041579:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.041587:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.041720:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.041724:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.041730:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.041752:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.041762:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.041769:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.041824:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919656.042313:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.042319:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.042328:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.042331:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.042336:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.042345:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.042352:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.042369:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042581:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919656.042590:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042608:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.042613:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042637:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042654:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042661:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad159149d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042679:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919656.042682:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042688:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2ce00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.042691:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042699:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042708:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.042714:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.042716:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.042724:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.042838:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919656.042844:0:17918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc6d94e/0x951c50ad159149d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919656.043340:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.043346:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.043356:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.043360:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.043365:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.043376:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.043390:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.043399:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.043413:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.043426:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919656.043488:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919656.043494:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.043504:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.043509:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.043519:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.043533:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.043542:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad159149df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.043573:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.043576:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.043577:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790919656.043880:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790919656.044441:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.044449:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.044460:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.044464:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.044468:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.044479:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.044488:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.044496:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.044567:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919656.045084:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.045089:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.045099:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.045108:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.045112:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.045122:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.045130:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.045138:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045344:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919656.045352:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045359:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2ca00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.045370:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045378:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045392:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045399:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad159149e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045419:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919656.045422:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045429:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.045432:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045439:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045447:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.045453:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.045460:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.045462:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.047247:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919656.047262:0:17918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d8634a/0x951c50ad159149ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919656.047932:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.047939:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.047953:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.047957:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.047962:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.047975:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.047991:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.047999:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.050043:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919656.050064:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.050076:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919656.050081:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.050091:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.050110:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.050121:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.050122:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919656.050124:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919656.050511:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919656.050519:0:17918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de46110d/0x951c50ad159149f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919656.050991:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919656.051545:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.051553:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.053754:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.053760:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.053769:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.053784:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.053795:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.053816:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.053846:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919656.054767:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.054775:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.054787:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.054790:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.054794:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.054804:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.054811:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.054818:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.054837:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790919656.055373:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.055380:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.055395:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.055398:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.055402:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.055411:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.055418:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.055425:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.055432:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790919656.056117:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.056125:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.056135:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.056139:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.056143:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.056151:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.056170:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.056177:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.056185:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1790919656.056603:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.056610:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057089:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.057093:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.057097:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057108:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057117:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057124:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057143:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1790919656.057555:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.057573:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057582:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.057584:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.057588:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057597:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057605:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057613:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.057716:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1790919656.058224:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919656.058231:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058240:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790919656.058249:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.058254:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058264:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058272:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058279:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058287:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1790919656.058715:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790919656.058724:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058735:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2da00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.058740:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058750:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058775:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058784:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7761f2c/0x951c50ad159149fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058812:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790919656.058817:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058824:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.058828:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919656.058834:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919656.058838:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058841:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058858:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790919656.058859:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058861:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919656.058869:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058875:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be1db55a/0x951c50ad15914a02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058882:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058891:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058895:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790919656.058902:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058906:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919656.058927:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1790919656.058940:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.058944:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058954:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058966:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058974:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914a09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.058991:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790919656.058995:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059002:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2dc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.059006:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059014:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059025:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059040:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f0551be/0x951c50ad15914a10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059077:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790919656.059081:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059089:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.059093:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059101:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059113:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059121:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cdf8d5/0x951c50ad15914a17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059140:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790919656.059144:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059151:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.059161:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059171:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059183:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059191:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914a1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059209:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919656.059213:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1790919656.059217:0:17918:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:2.0:1790919656.059221:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2cc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.059226:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059234:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059243:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059251:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002addb0fb/0x951c50ad15914a25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059275:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919656.059279:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059285:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919656.059288:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059295:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059307:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919656.059316:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fefa278/0x951c50ad15914a2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919656.059317:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16431:x1877914978267136:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73396us (91187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919656.059337:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790919656.059352:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919656.059355:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919656.059358:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919656.059394:0:16431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16431:1877914978267136:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790919656.059409:0:16431:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1790919656.059448:0:16431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16431:1877914978267264:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790919656.059478:0:16431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919656.059547:0:16431:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919656.059574:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267264 00000100:00100000:3.0:1790919656.059579:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267264 00010000:00010000:0.0:1790919656.059665:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919656.059680:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919656.059691:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:16431:x1877914978267264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790919656.059730:0:17714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:2.0:1790919656.064448:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:16431:x1877914978267264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4752us (4962us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790919656.064470:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919656.065249:0:16431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16431:1877914978267264:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790919656.065268:0:16431:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1790919656.101697:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919656.860463:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978267392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919656.860547:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919656.860600:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919656.860607:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978267520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919656.860636:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919656.860638:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267392 00000100:00100000:0.0:1790919656.860648:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267392 00000100:00100000:1.0:1790919656.860672:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267520 00000100:00100000:1.0:1790919656.860677:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267520 00000100:00100000:0.0:1790919656.860693:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919656.860711:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978267392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919656.860750:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919656.860802:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978267392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919656.861594:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978267392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919656.862961:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919656.863001:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919656.863017:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978267520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919656.863774:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919656.863846:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978267520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 836us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919656.863854:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790919656.863903:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978267520:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790919657.116274:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919658.140169:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919658.481268:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790919658.481290:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:02000400:1.0:1790919658.507533:0:18082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790919659.166931:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919660.189628:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919661.213172:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919661.471793:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978267648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919661.471861:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919661.471936:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267648 00000100:00100000:3.0:1790919661.471944:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267648 00000100:00100000:3.0:1790919661.471992:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919661.472000:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978267648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919661.472049:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919661.472117:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978267648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919661.472125:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790919661.472145:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919661.472172:0:3458:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790919661.472192:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978267648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919661.473941:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978267776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919661.473997:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790919661.474080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919661.474085:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790919661.474089:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919661.474094:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:0.0:1790919661.474099:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790919661.474118:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f383f4b800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919661.474141:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285598a80 x1877914978268032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919661.474283:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267776 00000100:00100000:2.0:1790919661.474291:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267776 00000100:00100000:2.0:1790919661.474330:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919661.474339:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3459:x1877914978267776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790919661.475536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919661.475543:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919661.475545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919661.475548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790919661.475696:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978267904:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.475746:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919661.475772:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978268544:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.475796:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919661.475813:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790919661.475819:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978268160:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.475835:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919661.475849:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978268672:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.476004:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919661.476095:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978267904 00000100:00100000:0.0:1790919661.476102:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978267904 00000100:00100000:0.0:1790919661.476144:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919661.476151:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978267904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.476202:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978267904:12345-0@lo:400:kworker.0 Request processed in 51us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919661.476209:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919661.476231:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268544 00000100:00100000:0.0:1790919661.476245:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268544 00000100:00100000:0.0:1790919661.476276:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268160 00000100:00100000:0.0:1790919661.476279:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268160 00000100:00100000:0.0:1790919661.476289:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268672 00000100:00100000:0.0:1790919661.476291:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268672 00000100:00100000:0.0:1790919661.476305:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919661.476312:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978268544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.476343:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978268544:12345-0@lo:400:kworker.0 Request processed in 32us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919661.476349:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919661.476361:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919661.476367:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978268160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.476460:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978268160:12345-0@lo:400:kworker.0 Request processed in 93us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919661.476465:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919661.476476:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919661.476481:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978268672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.476503:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978268672:12345-0@lo:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919661.476508:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790919661.476612:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f28559a300 x1877914978268160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919661.476626:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978268160:0@lo:400:kworker.0 00010000:00080000:0.0:1790919661.476638:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285599180 x1877914978268672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919661.476646:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978268672:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.476663:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978267904:0@lo:400:kworker.0 00010000:00080000:0.0:1790919661.476671:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285599500 x1877914978268544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919661.476678:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978268544:0@lo:400:kworker.0 00000100:00080000:0.0:1790919661.477094:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919661.477099:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919661.477120:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978268288:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.477160:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919661.477184:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919661.477191:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978268416:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.477215:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919661.477237:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268288 00000100:00100000:0.0:1790919661.477242:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268288 00000100:00100000:0.0:1790919661.477268:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919661.477274:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978268288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.477312:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978268288:12345-0@lo:400:kworker.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919661.477318:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919661.477334:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268416 00000100:00100000:0.0:1790919661.477337:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268416 00000100:00100000:0.0:1790919661.477356:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790919661.477362:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978268416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919661.478715:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3459:x1877914978267776:12345-0@lo:400:kworker.0 Request processed in 4369us (4709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919661.478729:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919661.478780:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978268032:0@lo:8:kworker.0 00000100:00100000:2.0:1790919661.478821:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919661.478863:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268032 00000100:00100000:2.0:1790919661.478882:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268032 00000100:00100000:2.0:1790919661.478912:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919661.479097:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978268416:12345-0@lo:400:kworker.0 Request processed in 1732us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919661.479106:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790919661.479163:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285599c00 x1877914978268416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919661.479176:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978268416:0@lo:400:kworker.0 00000100:00100000:0.0:1790919661.479188:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978268288:0@lo:400:kworker.0 00000100:00100000:2.0:1790919661.479477:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978268032:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790919661.479500:0:17711:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790919661.482695:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978267776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919661.502800:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978268032:12345-0@lo:8:kworker.0 Request processed in 23315us (23969us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919661.502814:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790919661.504761:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919661.504771:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919661.504776:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978268032:0@lo:8:kworker.0 00000100:00100000:1.0:1790919661.980354:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978268800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919661.980429:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919661.980484:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268800 00000100:00100000:1.0:1790919661.980492:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268800 00000100:00100000:1.0:1790919661.980549:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919661.980568:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978268800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919661.980610:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919661.980657:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978268800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919661.980663:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919661.980708:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978268800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919661.980918:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978268928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919661.980950:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919661.980981:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978268928 00000100:00100000:3.0:1790919661.980985:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978268928 00000100:00100000:3.0:1790919661.981009:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919661.981015:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978268928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919661.981035:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919661.981099:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978268928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919661.981106:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790919661.981136:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978268928:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790919662.245802:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919662.556899:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919663.262417:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919663.792865:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790919664.284531:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790919664.785106:0:18432:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790919664.785110:0:18432:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790919664.785243:0:18432:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f3bd7e8000 00000020:01000004:2.0:1790919664.785258:0:18432:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790919664.785274:0:18432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790919664.785288:0:18432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95f284f48000) 00000020:00000080:2.0:1790919664.785305:0:18432:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790919664.805487:0:18432:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790919664.805739:0:18432:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790919664.807707:0:18432:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790919664.808363:0:18432:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790919664.808699:0:18432:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790919664.809714:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 553: rc = 0 00100000:10000000:3.0:1790919664.809806:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 553: rc = 0 00100000:10000000:3.0:1790919664.810030:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 553: rc = 0 00100000:10000000:3.0:1790919664.810644:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:3.0:1790919664.811459:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 771: rc = 0 00100000:10000000:3.0:1790919664.812480:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:3.0:1790919664.812744:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:3.0:1790919664.817694:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 771: rc = 0 00100000:10000000:3.0:1790919664.820171:0:18432:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 771: rc = 0 00000020:00000080:3.0:1790919664.820849:0:18432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790919664.820864:0:18432:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790919664.820874:0:18432:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x951c50ad15914a3a 00000020:01000004:3.0:1790919664.820882:0:18432:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790919664.820903:0:18432:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790919664.820906:0:18432:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790919664.820912:0:18432:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790919664.820933:0:18432:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790919664.820937:0:18432:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790919664.851258:0:18432:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790919664.851804:0:18432:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790919664.851809:0:18432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790919664.851811:0:18432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919664.851812:0:18432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919664.851814:0:18432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919664.851815:0:18432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919664.851817:0:18432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919664.851818:0:18432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919664.851820:0:18432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919664.851821:0:18432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919664.851825:0:18432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790919664.851828:0:18432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919664.851829:0:18432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919664.851830:0:18432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919664.851831:0:18432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919664.851832:0:18432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919664.851833:0:18432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919664.851834:0:18432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919664.851836:0:18432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919664.851837:0:18432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919664.851863:0:18432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790919664.851889:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919664.851953:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919664.852100:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391446d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919664.852376:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269056 00000100:00100000:0.0:1790919664.852385:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269056 00000100:00100000:0.0:1790919664.852575:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790919664.852585:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:18432:x1877914978269056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919664.852623:0:16400:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790919664.852626:0:16400:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790919664.852630:0:16400:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790919664.866460:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:18432:x1877914978269056:12345-0@lo:253:mount.lustre.0 Request processed in 13867us (14497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.866476:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919664.869103:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919664.869125:0:18432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790919664.869129:0:18432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919664.869131:0:18432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919664.869132:0:18432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919664.869151:0:18432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919664.869152:0:18432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919664.869154:0:18432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919664.869155:0:18432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919664.869157:0:18432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919664.869159:0:18432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790919664.870162:0:18432:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3bd7e8000 from lustre-OST0001 10000000:01000000:3.0:1790919664.870194:0:18432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790919664.870198:0:18432:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790919664.870213:0:18432:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f3a68bcd40 local copy 00010000:00010000:3.0:1790919664.870223:0:18432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919664.870591:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919664.870653:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.871112:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919664.875196:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269184 00000100:00100000:2.0:1790919664.875211:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269184 00000100:00100000:3.0:1790919664.877653:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790919664.877668:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:18432:x1877914978269184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919664.878099:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:18432:x1877914978269184:12345-0@lo:501:mount.lustre.0 Request processed in 434us (7444us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919664.878107:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790919664.878199:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269184:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790919664.878221:0:18432:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790919664.878408:0:18432:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790919664.878419:0:18432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919664.878430:0:18432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919664.878463:0:18432:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3bd7e8000 10000000:01000000:0.0:1790919664.878468:0:18432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919664.878474:0:18432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790919664.878483:0:18432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919664.878488:0:18432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790919664.878491:0:18432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790919664.878532:0:18432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919664.878540:0:18432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919664.878550:0:18432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919664.878571:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919664.878607:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919664.882675:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269312 00000100:00100000:2.0:1790919664.882690:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269312 00000100:00100000:2.0:1790919664.882742:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790919664.882753:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:18432:x1877914978269312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919664.882771:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919664.882789:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ee200/0x951c50ad15914a48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914a41 expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.882818:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee200/0x951c50ad15914a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914a41 expref: 22 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.882829:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ee200/0x951c50ad15914a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914a41 expref: 22 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.882838:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ee200, rc 0) 00000100:00100000:1.0:1790919664.882908:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3920ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919664.883625:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919664.883626:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269312:12345-0@lo:101:mount.lustre.0 Request processed in 873us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.883639:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:1.0:1790919664.883649:0:18432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919664.883662:0:18432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919664.884916:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790919664.886325:0:18432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919664.886617:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790919664.886671:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790919664.886709:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790919664.886753:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790919664.886787:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790919664.886832:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790919664.886888:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790919664.886906:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790919664.886994:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919664.887072:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.887120:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919664.887646:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269440 00000100:00100000:2.0:1790919664.887654:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269440 00000100:00100000:2.0:1790919664.887703:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790919664.887711:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919664.888107:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269440:12345-0@lo:501:mount.lustre.0 Request processed in 396us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.888121:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790919664.889217:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919664.889286:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919664.889353:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.889389:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919664.890211:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269568 00000100:00100000:0.0:1790919664.890219:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269568 00000100:00100000:0.0:1790919664.890362:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790919664.890372:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919664.890744:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269568:12345-0@lo:503:mount.lustre.0 Request processed in 373us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.890753:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790919664.890889:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790919664.892659:0:18432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919664.892738:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919664.892819:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.892876:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.893158:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269696 00000100:00100000:3.0:1790919664.893166:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269696 00000100:00100000:3.0:1790919664.893216:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790919664.893226:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919664.893669:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269696:12345-0@lo:502:mount.lustre.0 Request processed in 444us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.893677:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790919664.893772:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919664.894016:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790919664.894098:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790919664.894131:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1790919664.894184:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1790919664.894224:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1790919664.894273:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1790919664.894320:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1790919664.894368:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1790919664.894419:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1790919664.894451:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919664.894515:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.894542:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919664.894798:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269824 00000100:00100000:0.0:1790919664.894804:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269824 00000100:00100000:0.0:1790919664.894846:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790919664.894855:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919664.895191:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269824:12345-0@lo:502:mount.lustre.0 Request processed in 337us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.895199:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919664.895484:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919664.895571:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1790919664.895581:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790919664.897213:0:18433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790919664.897223:0:18433:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790919664.897229:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919664.897231:0:18433:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790919664.897237:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919664.897251:0:18433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95f284f499c0) 00000020:00000080:2.0:1790919664.897280:0:18433:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790919664.897287:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790919664.897361:0:18433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3bd7e8000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790919664.897370:0:18433:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919664.897377:0:18433:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x951c50ad15914a56 00010000:00010000:3.0:1790919664.902414:0:18433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790919664.902886:0:18433:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1790919664.904788:0:18433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1790919664.907162:0:18433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790919664.907174:0:18433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919664.907180:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919664.907182:0:18433:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790919664.907187:0:18433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919664.907191:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919664.907192:0:18433:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790919664.907196:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790919664.907198:0:18433:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790919664.907200:0:18433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919664.907202:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919664.907203:0:18433:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790919664.907206:0:18433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919664.907208:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919664.907209:0:18433:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790919664.907213:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790919664.907271:0:18433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919664.907275:0:18433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919664.907277:0:18433:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790919664.907280:0:18433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790919664.907591:0:18432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790919664.907617:0:18432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790919664.907640:0:18432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.907670:0:18432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919664.907678:0:18432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3bd7e8000 from 1 10000000:01000000:3.0:1790919664.907681:0:18432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919664.907717:0:18432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.907725:0:18432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.907736:0:18432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919664.907762:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919664.908292:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.908334:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919664.908408:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978269952 00000100:00100000:2.0:1790919664.908416:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978269952 00000100:00100000:2.0:1790919664.908468:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790919664.908477:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978269952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919664.908490:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919664.908512:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914a5d expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.908535:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.908545:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.908553:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f2860ef600, rc 0) 00000100:00100000:2.0:1790919664.908600:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978269952:12345-0@lo:101:mount.lustre.0 Request processed in 124us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.908619:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790919664.909005:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978269952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919664.909021:0:18432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.909032:0:18432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919664.909573:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790919664.911236:0:18432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919664.911554:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790919664.911602:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790919664.911679:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790919664.911688:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790919664.911769:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919664.913121:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.913158:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919664.913675:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270080 00000100:00100000:2.0:1790919664.913683:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270080 00000100:00100000:2.0:1790919664.913734:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790919664.913743:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919664.914040:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270080:12345-0@lo:501:mount.lustre.0 Request processed in 297us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.914048:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790919664.918520:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919664.918605:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919664.918671:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.918707:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.919072:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270208 00000100:00100000:3.0:1790919664.919079:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270208 00000100:00100000:3.0:1790919664.919127:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790919664.919136:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919664.919479:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270208:12345-0@lo:503:mount.lustre.0 Request processed in 343us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.919488:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790919664.919577:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790919664.920736:0:18432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919664.920887:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919664.921587:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.921628:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.921782:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270336 00000100:00100000:3.0:1790919664.921788:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270336 00000100:00100000:3.0:1790919664.921827:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790919664.921836:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919664.922407:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270336:12345-0@lo:502:mount.lustre.0 Request processed in 571us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.922416:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790919664.922517:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919664.922754:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790919664.922818:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790919664.922870:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790919664.923402:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790919664.923444:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790919664.923534:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790919664.923575:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790919664.923607:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1790919664.923660:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790919664.923689:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1790919664.923716:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1790919664.923751:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919664.923867:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.924160:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.924289:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270464 00000100:00100000:3.0:1790919664.924296:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270464 00000100:00100000:3.0:1790919664.924373:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790919664.924382:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919664.924580:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270464:12345-0@lo:502:mount.lustre.0 Request processed in 198us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.924588:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790919664.924663:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919664.924757:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1790919664.924769:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790919664.925692:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919664.925703:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925705:0:18437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790919664.925712:0:18437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3bd7e8000 00000020:00000080:1.0:1790919664.925715:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919664.925722:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919664.925724:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925726:0:18437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790919664.925728:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919664.925730:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925731:0:18437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790919664.925734:0:18437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3bd7e8000 00000020:00000080:1.0:1790919664.925736:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919664.925796:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919664.925800:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925801:0:18437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790919664.925804:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919664.925807:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925808:0:18437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790919664.925811:0:18437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3bd7e8000 00000020:00000080:1.0:1790919664.925814:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919664.925830:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919664.925833:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925835:0:18437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790919664.925837:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790919664.925839:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925841:0:18437:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790919664.925844:0:18437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3bd7e8000 00000020:00000080:1.0:1790919664.925846:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790919664.925882:0:18437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790919664.925886:0:18437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790919664.925900:0:18437:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790919664.925903:0:18437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1790919664.934785:0:18432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790919664.935091:0:18432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919664.935114:0:18432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.935126:0:18432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919664.935178:0:18432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790919664.935182:0:18432:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3bd7e8000 10000000:01000000:2.0:1790919664.935185:0:18432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3bd7e8000 10000000:01000000:2.0:1790919664.935189:0:18432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790919664.935194:0:18432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3bd7e8000 from 1 10000000:01000000:2.0:1790919664.935196:0:18432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790919664.935230:0:18432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.935238:0:18432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.935249:0:18432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919664.935281:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919664.935345:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919664.935378:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211300 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.935447:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270592 00000100:00100000:3.0:1790919664.935461:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270592 00000100:00100000:3.0:1790919664.935515:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790919664.935524:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:18432:x1877914978270592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919664.935537:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919664.935548:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2d600/0x951c50ad15914a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914a6b expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.935571:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2d600/0x951c50ad15914a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914a6b expref: 24 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.935581:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2d600/0x951c50ad15914a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914a6b expref: 24 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919664.935591:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2d600, rc 0) 00000100:00100000:3.0:1790919664.935629:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270592:12345-0@lo:101:mount.lustre.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.935635:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919664.937126:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919664.937147:0:18432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919664.937159:0:18432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919664.939280:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1790919664.941149:0:18432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919664.941433:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790919664.941471:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790919664.941514:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790919664.941554:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790919664.941582:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790919664.941618:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790919664.941646:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790919664.941687:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790919664.941727:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790919664.941755:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790919664.941781:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790919664.943310:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790919664.943373:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790919664.943407:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790919664.943453:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790919664.943487:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790919664.943533:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790919664.943590:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790919664.943621:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790919664.943654:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790919664.943705:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790919664.943759:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790919664.943799:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790919664.944634:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790919664.944677:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1790919664.944711:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1790919664.944830:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1790919664.944873:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1790919664.945188:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1790919664.945245:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1790919664.945281:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1790919664.945314:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1790919664.945346:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1790919664.945393:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1790919664.945428:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1790919664.945474:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1790919664.945523:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1790919664.945556:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1790919664.945603:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1790919664.945653:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1790919664.945687:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1790919664.945719:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1790919664.945884:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1790919664.946133:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1790919664.946173:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1790919664.946221:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1790919664.946320:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1790919664.946328:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1790919664.946450:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919664.946627:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919664.946664:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211300 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.946960:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270720 00000100:00100000:3.0:1790919664.946969:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270720 00000100:00100000:3.0:1790919664.947181:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790919664.947191:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919664.947433:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270720:12345-0@lo:501:mount.lustre.0 Request processed in 243us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.947442:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790919664.947474:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919664.947530:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919664.947573:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.947599:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919664.947693:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270848 00000100:00100000:2.0:1790919664.947698:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270848 00000100:00100000:2.0:1790919664.947734:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919664.947742:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919664.948237:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270848:12345-0@lo:503:mount.lustre.0 Request processed in 494us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.948245:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790919664.948305:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919664.949701:0:18432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919664.949780:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919664.950748:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919664.950792:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211540 going to sleep for 11 seconds 00000100:00100000:3.0:1790919664.951691:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978270976 00000100:00100000:3.0:1790919664.951700:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978270976 00000100:00100000:3.0:1790919664.951753:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790919664.951762:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919664.952372:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978270976:12345-0@lo:502:mount.lustre.0 Request processed in 609us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919664.952380:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919664.952798:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978270976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919664.954316:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790919664.954375:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790919664.954403:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790919664.954441:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790919664.954471:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790919664.954686:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790919664.954745:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790919664.954778:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790919664.954874:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790919664.954966:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790919664.955096:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790919664.955156:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790919664.955185:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790919664.955211:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790919664.955247:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790919664.955274:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790919664.955299:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790919664.955335:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790919664.955362:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790919664.955387:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790919664.955423:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790919664.955449:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790919664.955488:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790919664.955542:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790919664.955570:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1790919664.955596:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1790919664.955632:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1790919664.955658:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1790919664.955684:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1790919664.955719:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1790919664.955745:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1790919664.955772:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1790919664.955810:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1790919664.955851:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1790919664.955879:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1790919664.958306:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1790919664.958363:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1790919664.958394:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1790919664.958461:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1790919664.958508:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1790919664.958539:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1790919664.958570:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1790919664.958617:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1790919664.958654:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1790919664.958702:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1790919664.958750:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1790919664.958784:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1790919664.960226:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1790919664.960320:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978271104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919664.960403:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.960447:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919664.960550:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271104 00000100:00100000:0.0:1790919664.960558:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271104 00000100:00100000:0.0:1790919664.960614:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790919664.960623:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978271104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919664.960860:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978271104:12345-0@lo:502:mount.lustre.0 Request processed in 237us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.960868:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790919664.961240:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978271104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919664.961360:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1790919664.961404:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1790919664.961434:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978271232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919664.961477:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.961522:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919664.961959:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271232 00000100:00100000:0.0:1790919664.961966:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271232 00000100:00100000:0.0:1790919664.962130:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790919664.962139:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978271232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919664.963702:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978271232:12345-0@lo:502:mount.lustre.0 Request processed in 1557us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.963713:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790919664.967325:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978271232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919664.967545:0:18432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1790919664.967562:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790919664.969183:0:18443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790919664.969198:0:18443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95f284f4b380) 00000020:00000080:2.0:1790919664.969222:0:18443:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1790919664.969313:0:18443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3bd7e8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790919664.969317:0:18443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3bd7e8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790919664.969319:0:18443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3bd7e8000 3 00010000:00080000:2.0:1790919664.969355:0:18443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f284009800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919664.972748:0:18443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1790919664.974307:0:18443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790919664.974352:0:18443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919664.974365:0:18443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x951c50ad15914a80 00000100:00080000:1.0:1790919664.974375:0:18443:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919664.974387:0:18443:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f284009800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919664.974425:0:18443:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aab100 x1877914978271360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919664.974459:0:18443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790919664.977878:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978271360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790919664.978163:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.978242:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271360 00000100:00100000:0.0:1790919664.978250:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271360 00000100:00080000:3.0:1790919664.978282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1790919664.978285:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1790919664.978286:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790919664.978290:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1790919664.978292:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978271360:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790919664.978295:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1790919664.978299:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790919664.978306:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f383f4b800 using connection 192.168.203.111@tcp/0@lo 00010000:00080000:0.0:1790919664.978317:0:16408:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000100:00100000:3.0:1790919664.978323:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2860fd880 x1877914978271872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919664.978347:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919664.978350:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:0.0:1790919664.978351:0:16408:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x951c50ad15914a87 00000100:00080000:3.0:1790919664.978353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919664.978355:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00100000:0.0:1790919664.978364:0:16408:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919664.978391:0:16408:0:(import.c:65:import_set_state_nolock()) ffff95f284290800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919664.978438:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1877914978271360:12345-0@lo:38:llog_process_th.0 Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.978445:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919664.978468:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978271616:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.978508:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.978529:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978272256:0@lo:400:kworker.0 00000100:00100000:3.0:1790919664.978549:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978271744:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.978549:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.978567:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790919664.978572:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978271488:0@lo:400:kworker.0 00000100:00100000:3.0:1790919664.978574:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.978590:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978272384:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.978596:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.978609:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978272128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919664.978611:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.978627:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790919664.978628:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.978631:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978272000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.978652:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272256 00000100:00100000:0.0:1790919664.978655:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272256 00000100:00100000:3.0:1790919664.978660:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919664.978671:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978272512:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.978677:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272384 00000100:00100000:0.0:1790919664.978679:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272384 00000100:00100000:3.0:1790919664.978692:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.978699:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272000 00000100:00100000:0.0:1790919664.978702:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272000 00000100:00100000:0.0:1790919664.978711:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272512 00000100:00100000:3.0:1790919664.978713:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978271872:0@lo:8:kworker.0 00000100:00100000:0.0:1790919664.978718:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272512 00000100:00100000:3.0:1790919664.978735:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919664.978737:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919664.978743:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978272256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.978779:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978272256:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.978785:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919664.979140:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919664.979148:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978272384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979182:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978272384:12345-0@lo:400:kworker.0 Request processed in 36us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.979188:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919664.979199:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919664.979204:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978272000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979225:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978272000:12345-0@lo:400:kworker.0 Request processed in 21us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.979230:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919664.979238:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919664.979243:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978272512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979262:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978272512:12345-0@lo:400:kworker.0 Request processed in 20us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.979267:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919664.979281:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271616 00000100:00100000:0.0:1790919664.979284:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271616 00000100:00100000:0.0:1790919664.979298:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272128 00000100:00100000:0.0:1790919664.979300:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272128 00000100:00100000:0.0:1790919664.979309:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919664.979313:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978271616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979347:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978271616:12345-0@lo:400:kworker.0 Request processed in 33us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.979352:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919664.979362:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919664.979367:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978272128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979386:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978272128:12345-0@lo:400:kworker.0 Request processed in 20us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.979391:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790919664.979410:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919664.979414:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790919664.979434:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f2845aa300 x1877914978272000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919664.979447:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978272000:0@lo:400:kworker.0 00010000:00080000:0.0:1790919664.979456:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f2845aa680 x1877914978272512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919664.979464:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978272512:0@lo:400:kworker.0 00010000:00080000:0.0:1790919664.979472:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f2845aad80 x1877914978272384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919664.979479:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978272384:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979517:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978272128:0@lo:400:kworker.0 00000100:00100000:0.0:1790919664.979524:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978271616:0@lo:400:kworker.0 00010000:00080000:0.0:1790919664.979533:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f2845ab480 x1877914978272256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919664.979552:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978272256:0@lo:400:kworker.0 00010000:00080000:3.0:1790919664.980912:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285aab100 x1877914978271360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919664.980924:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790919664.980932:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1790919664.980939:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790919664.980943:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790919664.980946:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790919664.980952:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978271360:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1790919664.981475:0:18443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790919664.981506:0:18443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff95f38d584d40) 00000020:00000080:1.0:1790919664.981533:0:18443:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1790919664.981632:0:18443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3bd7e8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790919664.981636:0:18443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3bd7e8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790919664.981639:0:18443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3bd7e8000 3 00010000:00080000:1.0:1790919664.981668:0:18443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3bd7ec800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00000100:00100000:2.0:1790919664.984312:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271744 00000100:00100000:2.0:1790919664.984325:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271744 00000100:00100000:2.0:1790919664.984402:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271872 00000100:00100000:2.0:1790919664.984406:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271872 00000100:00100000:2.0:1790919664.984428:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919664.984437:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978271744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919664.984541:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978271744:12345-0@lo:400:kworker.0 Request processed in 106us (5965us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.984549:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919664.984567:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790919664.984571:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978271872:12345-0@lo:8:kworker.0 00010000:00010000:1.0:1790919664.984886:0:18443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1790919664.985557:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978271872:12345-0@lo:8:kworker.0 Request processed in 981us (6818us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790919664.985566:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790919664.985595:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978271488 00000020:00000080:1.0:1790919664.985596:0:18443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000100:00100000:2.0:1790919664.985602:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978271488 00000100:00100000:2.0:1790919664.985634:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000010:01000000:1.0:1790919664.985642:0:18443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000100:00100000:2.0:1790919664.985643:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3461:x1877914978271488:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1790919664.985656:0:18443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x951c50ad15914a95 00000100:00080000:1.0:1790919664.985666:0:18443:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919664.985677:0:18443:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff95f3bd7ec800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919664.985698:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3461:x1877914978271488:12345-0@lo:400:kworker.0 Request processed in 55us (7099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919664.985708:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790919664.985708:0:18443:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285aa8000 x1877914978272640/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919664.985726:0:18443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790919664.986176:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978272640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919664.986225:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.986360:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919664.986369:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919664.986373:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790919664.986377:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978271872:0@lo:8:kworker.0 00000100:00100000:2.0:1790919664.986395:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978271488:0@lo:400:kworker.0 00000100:00100000:1.0:1790919664.986423:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978271744:0@lo:400:kworker.0 00000100:00080000:0.0:1790919664.986924:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919664.986940:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272640 00000100:00100000:0.0:1790919664.986945:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272640 00000100:00100000:0.0:1790919664.986972:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919664.986979:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978272640:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790919664.987011:0:16405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1790919664.987044:0:16405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x951c50ad15914a9c 00000004:00100000:0.0:1790919664.987073:0:16405:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919664.987102:0:16405:0:(import.c:65:import_set_state_nolock()) ffff95f284292000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919664.987156:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3457:x1877914978272640:12345-0@lo:38:llog_process_th.0 Request processed in 176us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919664.987164:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790919664.987207:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285aa8000 x1877914978272640/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919664.987216:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919664.987222:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790919664.987229:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790919664.987233:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790919664.987236:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7ec800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919664.987240:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978272640:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790919664.987377:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919664.987383:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919664.987386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919664.987390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790919664.987391:0:18443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1790919664.990128:0:18432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790919664.990172:0:18432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919664.990189:0:18432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919664.990202:0:18432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919664.990250:0:18432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919664.990252:0:18432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919664.990254:0:18432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919664.990259:0:18432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919664.990260:0:18432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919664.990261:0:18432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919664.990263:0:18432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919664.990264:0:18432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919664.990266:0:18432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919664.990269:0:18432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790919664.990271:0:18432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919664.990272:0:18432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919664.990273:0:18432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919664.990274:0:18432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919664.990275:0:18432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919664.990276:0:18432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919664.990277:0:18432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919664.990278:0:18432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919664.990279:0:18432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919664.990312:0:18432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790919664.990330:0:18432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978272768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919664.990392:0:18432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919664.990426:0:18432:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919664.990613:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272768 00000100:00100000:2.0:1790919664.990620:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272768 00000100:00100000:2.0:1790919664.990656:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790919664.990664:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:18432:x1877914978272768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790919664.990688:0:16398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790919664.990702:0:16398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790919665.027102:0:16398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790919665.027130:0:16398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790919665.027152:0:16422:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790919665.027156:0:16422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790919665.027178:0:16422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919665.027197:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914953 expref: 24 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919665.027206:0:16422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919665.027215:0:16422:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919665.027252:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919665.027267:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919665.027280:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978272896:0@lo:104: 00000100:00100000:2.0:1790919665.027345:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919665.027388:0:16422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914953 expref: 24 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919665.027397:0:16422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914953 expref: 24 pid: 16401 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919665.027405:0:16422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978273024:0@lo:104: 00000100:00100000:2.0:1790919665.027428:0:16422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919665.027455:0:16422:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919665.027617:0:16389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978272896 00000100:00100000:1.0:1790919665.027625:0:16389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978272896 00000100:00100000:1.0:1790919665.027669:0:16389:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273024 00000100:00100000:1.0:1790919665.027672:0:16389:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273024 00000100:00100000:1.0:1790919665.027685:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919665.027692:0:16389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:16422:x1877914978272896:12345-0@lo:104: 00010000:00010000:1.0:1790919665.027704:0:16389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919665.027769:0:16389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919665.027776:0:16389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:16422:x1877914978272896:12345-0@lo:104: Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919665.027783:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919665.027802:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919665.027816:0:16389:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978273024:12345-0@lo:104: 00010000:00010000:1.0:1790919665.027823:0:16389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919665.027868:0:16389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790919665.027873:0:16389:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:16422:x1877914978273024:12345-0@lo:104: Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919665.027878:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1790919665.028083:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919665.028092:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.028100:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919665.028105:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.028126:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919665.028134:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919665.028140:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790919665.028179:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.028186:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919665.028207:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919665.028277:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919665.028567:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919665.028579:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919665.028587:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919665.028590:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919665.028597:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919665.028602:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919665.028607:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919665.028626:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919665.028632:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919665.028639:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919665.028644:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591495a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919665.028656:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919665.028658:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919665.028659:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919665.028665:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919665.028666:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919665.028775:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ef200/0x951c50ad15914961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914968 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.028792:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919665.028793:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919665.028795:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919665.028809:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978273152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919665.028848:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919665.028893:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919665.028900:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978273280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919665.028925:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919665.029248:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273152 00000100:00100000:3.0:1790919665.029255:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273152 00000100:00100000:2.0:1790919665.029428:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978272896:0@lo:104: 00000100:00100000:2.0:1790919665.029439:0:16422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16422:1877914978273024:0@lo:104: 00010000:00010000:2.0:1790919665.029460:0:16422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919665.029533:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273280 00000100:00100000:1.0:1790919665.029538:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273280 00010000:00010000:1.0:1790919665.029572:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914953 expref: 26 pid: 16401 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919665.029606:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919665.029615:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+26:3460:x1877914978273280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919665.029629:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919665.029634:0:16393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914953 expref: 26 pid: 16401 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919665.029643:0:16393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914953 expref: 26 pid: 16401 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919665.029657:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ef800/0x951c50ad1591495a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914953 expref: 26 pid: 16401 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919665.029668:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919665.029715:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+25:3460:x1877914978273280:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919665.029721:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1790919665.029852:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919665.029889:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919665.029896:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3460:x1877914978273152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919665.029905:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919665.029911:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.029921:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.029931:0:16391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015a00/0x951c50ad15914968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914961 expref: 24 pid: 16398 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.029941:0:16391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.029949:0:16391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790919665.029961:0:16391:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003852935s 00010000:00010000:3.0:1790919665.029966:0:16391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.029972:0:16391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.029980:0:16391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919665.029990:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978273280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919665.030781:0:16391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.030798:0:16391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919665.030802:0:16391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.030811:0:16391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.030827:0:16391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.030837:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919665.030891:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:3460:x1877914978273152:12345-0@lo:103:ldlm_bl.0 Request processed in 991us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919665.030898:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919665.030932:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978273152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919665.030953:0:16422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.030961:0:16422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919665.030968:0:16422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee800/0x951c50ad15914aa3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919665.041897:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:18432:x1877914978272768:12345-0@lo:253:mount.lustre.0 Request processed in 51224us (51496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919665.041913:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790919665.042011:0:18432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb00aa6a-67be-455f-87d9-71f2084f0f0a:18432:1877914978272768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790919665.042028:0:18432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790919665.042032:0:18432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919665.042034:0:18432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919665.042035:0:18432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919665.042036:0:18432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919665.042037:0:18432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919665.042038:0:18432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919665.042040:0:18432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919665.042041:0:18432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919665.042043:0:18432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790919665.042089:0:18432:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919665.048757:0:18432:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919665.049011:0:18432:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919665.049216:0:18432:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919665.049380:0:18432:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919665.049557:0:18432:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919665.049767:0:18432:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790919665.050994:0:18432:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790919665.095133:0:18432:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790919665.095143:0:18432:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790919665.095174:0:18432:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919665.095250:0:18432:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919665.095266:0:18432:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790919665.095296:0:18432:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790919665.308409:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919666.014022:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919651/real 1790919651] req@ffff95f3b606b480 x1877914978261376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919666 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919666.014077:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3b606b480 x1877914978261376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919666 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919666.014087:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919651/real 1790919651] req@ffff95f3b6069880 x1877914978261504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919666 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919666.014099:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3b6069880 x1877914978261504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919666 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790919666.014117:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919666.014140:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919666.014145:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978261376:0@lo:8:kworker.0 00000100:00080000:0.0:1790919666.014341:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919666.014349:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919666.014353:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978261504:0@lo:8:kworker.0 00000100:00080000:3.0:1790919666.014418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919666.014427:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790919666.014430:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919666.014443:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f383f4b800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919666.014463:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2845a9f80 x1877914978273792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919666.014576:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919666.015039:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790919666.015042:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919666.015047:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1790919666.015077:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790919666.015083:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f392712000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919666.015099:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2845ab480 x1877914978274176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919666.015109:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919666.015112:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790919666.015113:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919666.015116:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1790919666.015119:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790919666.015123:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f387168800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919666.015132:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2845a8a80 x1877914978274304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919666.015184:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978273536:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.015243:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.015274:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978274432:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.015310:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.015329:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978274944:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.015354:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.015373:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790919666.015378:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978273408:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.015405:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.015431:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978274048:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.015450:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.015465:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978274816:0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.015866:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273408 00000100:00100000:2.0:1790919666.015874:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273408 00000100:00100000:2.0:1790919666.016423:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790919666.016433:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3459:x1877914978273408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.016683:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3459:x1877914978273408:12345-0@lo:400:kworker.0 Request processed in 250us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.016691:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790919666.017145:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273536 00000100:00100000:2.0:1790919666.017161:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273536 00000100:00100000:2.0:1790919666.017185:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274048 00000100:00100000:2.0:1790919666.017188:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274048 00000100:00100000:2.0:1790919666.017203:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919666.017209:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978273536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.017254:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978273536:12345-0@lo:400:kworker.0 Request processed in 45us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.017261:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919666.017274:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919666.017280:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978274048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.017309:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978274048:12345-0@lo:400:kworker.0 Request processed in 28us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.017314:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790919666.017337:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978273920:0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.017369:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.017394:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978274688:0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.017414:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.017428:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790919666.017434:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978273664:0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.017456:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.018044:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978274560:0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.018096:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.018123:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274432 00000100:00100000:2.0:1790919666.018128:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274432 00000100:00100000:2.0:1790919666.018155:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274944 00000100:00100000:2.0:1790919666.018158:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274944 00000100:00100000:2.0:1790919666.018182:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273920 00000100:00100000:2.0:1790919666.018194:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273920 00000100:00100000:2.0:1790919666.018208:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274688 00000100:00100000:2.0:1790919666.018210:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274688 00000100:00100000:2.0:1790919666.018220:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274560 00000100:00100000:2.0:1790919666.018222:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274560 00000100:00100000:2.0:1790919666.018235:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919666.018241:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978274432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.018281:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978274432:12345-0@lo:400:kworker.0 Request processed in 39us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.018287:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919666.018300:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919666.018306:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978274944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.018332:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978274944:12345-0@lo:400:kworker.0 Request processed in 27us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.018338:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919666.018349:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919666.018354:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978273920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.018384:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978273920:12345-0@lo:400:kworker.0 Request processed in 30us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.018390:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919666.018400:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919666.018405:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978274688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.018430:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978274688:12345-0@lo:400:kworker.0 Request processed in 25us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.018436:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919666.018447:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919666.018452:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978274560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.018510:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978274560:12345-0@lo:400:kworker.0 Request processed in 58us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.018517:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790919666.018534:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919666.018537:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919666.018547:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978273792:0@lo:8:kworker.0 00000100:00100000:2.0:1790919666.018573:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.018702:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.018736:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978273536:0@lo:400:kworker.0 00010000:00080000:3.0:1790919666.018749:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845aad80 x1877914978274432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919666.018759:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978274432:0@lo:400:kworker.0 00010000:00080000:3.0:1790919666.018768:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2871a9180 x1877914978274944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919666.018776:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978274944:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.018801:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978273408:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.018812:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978274048:0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.018843:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274816 00000100:00100000:3.0:1790919666.018847:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274816 00000100:00100000:3.0:1790919666.018998:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919666.019006:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978274816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919666.019048:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978274816:12345-0@lo:400:kworker.0 Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919666.019082:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1790919666.019108:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790919666.019124:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2871aa300 x1877914978274816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919666.019134:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978274816:0@lo:400:kworker.0 00000100:00100000:2.0:1790919666.019543:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978274176:0@lo:8:kworker.0 00000100:00100000:1.0:1790919666.019641:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273664 00000100:00100000:1.0:1790919666.019646:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273664 00000100:00100000:1.0:1790919666.019717:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978273792 00000100:00100000:1.0:1790919666.019721:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978273792 00000100:00100000:1.0:1790919666.019736:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919666.019744:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978273664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919666.019784:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978273664:12345-0@lo:400:kworker.0 Request processed in 41us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.019790:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919666.019802:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919666.019806:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3457:x1877914978273792:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790919666.019832:0:17712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1790919666.019858:0:17712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15914aaa 00002000:00100000:1.0:1790919666.019872:0:17712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95f3b4046800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790919666.019877:0:17712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:2.0:1790919666.020006:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.020033:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978274304:0@lo:8:kworker.0 00000100:00100000:2.0:1790919666.020079:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.020117:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978273664:0@lo:400:kworker.0 00010000:00080000:2.0:1790919666.020128:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845aa680 x1877914978274560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919666.020137:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978274560:0@lo:400:kworker.0 00010000:00080000:2.0:1790919666.020147:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845a8700 x1877914978273920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919666.020154:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978273920:0@lo:400:kworker.0 00010000:00080000:2.0:1790919666.020165:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845aa300 x1877914978274688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919666.020173:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978274688:0@lo:400:kworker.0 00002000:00100000:1.0:1790919666.021726:0:17712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790919666.022789:0:17712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790919666.022822:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f3b4040800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919666.022945:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978273792:12345-0@lo:8:kworker.0 Request processed in 3134us (4368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.022955:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919666.022980:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274176 00000100:00100000:1.0:1790919666.022985:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274176 00000100:00100000:1.0:1790919666.023002:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978274304 00000100:00100000:1.0:1790919666.023004:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978274304 00000100:00100000:1.0:1790919666.023014:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919666.023019:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3457:x1877914978274176:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790919666.023044:0:17712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1790919666.023084:0:17712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15914ab1 00002000:00100000:1.0:1790919666.023098:0:17712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff95f3b4044800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1790919666.023102:0:17712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1790919666.023105:0:17712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790919666.023249:0:17712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1790919666.023264:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f285da3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919666.023295:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978274176:12345-0@lo:8:kworker.0 Request processed in 275us (3717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.023303:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919666.023315:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919666.023320:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3457:x1877914978274304:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790919666.023336:0:17712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1790919666.023351:0:17712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15914ab8 00002000:00100000:1.0:1790919666.023357:0:17712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff95f285da6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790919666.023361:0:17712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1790919666.023363:0:17712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790919666.023407:0:17712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790919666.023420:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f285da5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919666.023451:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978274304:12345-0@lo:8:kworker.0 Request processed in 130us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.023458:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790919666.028119:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845a9f80 x1877914978273792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790919666.028143:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790919666.028152:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919666.028159:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790919666.028162:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790919666.028183:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919666.028189:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978273792:0@lo:8:kworker.0 00000100:00100000:1.0:1790919666.028205:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919666.028210:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790919666.028215:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919666.028217:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790919666.028219:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790919666.028316:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919666.028322:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978274176:0@lo:8:kworker.0 00010000:00080000:1.0:1790919666.028339:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845a8a80 x1877914978274304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919666.028347:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919666.028352:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790919666.028357:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790919666.028360:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790919666.028370:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790919666.028384:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790919666.028389:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978274304:0@lo:8:kworker.0 00000004:00080000:1.0:1790919666.028463:0:16433:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000004:00080000:2.0:1790919666.028576:0:17047:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790919666.029013:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16433:1877914978275200:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790919666.029087:0:16433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.029115:0:16433:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211b40 going to sleep for 11 seconds 00000004:00080000:1.0:1790919666.029129:0:16432:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790919666.029412:0:16432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 475057358710ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790919666.029447:0:17048:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790919666.029461:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17048:1877914978275456:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1790919666.029844:0:17047:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 475057790700ns, next at 0ns, rc = 0 00000100:00080000:3.0:1790919666.030036:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919666.030068:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275200 00000100:00100000:3.0:1790919666.030076:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275200 00000100:00100000:3.0:1790919666.030124:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919666.030134:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16433:x1877914978275200:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790919666.030633:0:17049:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790919666.031313:0:17048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.031336:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211180 going to sleep for 11 seconds 00000004:00080000:1.0:1790919666.031398:0:17050:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790919666.031421:0:17050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17050:1877914978275712:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790919666.031448:0:17050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.031457:0:17050:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00000004:00080000:2.0:1790919666.032074:0:17049:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 475060019925ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790919666.032271:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978275072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919666.032312:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.032342:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790919666.032349:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978275328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919666.032368:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.032400:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275456 00000100:00100000:1.0:1790919666.032406:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275456 00000100:00100000:1.0:1790919666.032438:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275712 00000100:00100000:1.0:1790919666.032441:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275712 00000100:00100000:1.0:1790919666.032463:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919666.033760:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17048:x1877914978275456:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1790919666.041157:0:17918:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1790919666.041179:0:17918:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790919666.041185:0:17918:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:1.0:1790919666.045765:0:17712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790919666.045778:0:17712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1790919666.045987:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17048:1877914978275456:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1790919666.046001:0:17048:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1790919666.046038:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17048:1877914978275840:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790919666.046762:0:17048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919666.046784:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919666.047299:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17048:x1877914978275456:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13549us (15984us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.047311:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919666.047341:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275840 00000100:00100000:1.0:1790919666.047349:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275840 00000100:00100000:1.0:1790919666.047378:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919666.047386:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17050:x1877914978275712:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790919666.051152:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978275584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919666.051303:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.051363:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275072 00000100:00100000:1.0:1790919666.051371:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275072 00000100:00100000:1.0:1790919666.051408:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275328 00000100:00100000:1.0:1790919666.051412:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275328 00000100:00100000:1.0:1790919666.051428:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275584 00000100:00100000:1.0:1790919666.051431:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275584 00000100:00100000:1.0:1790919666.051450:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919666.051460:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978275072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790919666.051506:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919666.051621:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3460:x1877914978275072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (19307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.051630:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919666.051648:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919666.051656:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3460:x1877914978275328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919666.051684:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919666.051718:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3460:x1877914978275328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (19348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.051724:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919666.051738:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919666.051745:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3458:x1877914978275584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919666.051753:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919666.051789:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3458:x1877914978275584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.051795:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919666.052498:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978275328:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1790919666.052516:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285aa9f80 x1877914978275072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919666.052598:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978275072:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790919666.053101:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285aa8380 x1877914978275584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919666.053117:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978275584:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790919666.054464:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919666.054472:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1790919666.064397:0:17712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790919666.064407:0:17712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1790919666.064515:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17050:x1877914978275712:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17123us (33060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.064534:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1790919666.064594:0:17050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285aabb80 x1877914978275712/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790919682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919666.064623:0:17050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17050:1877914978275712:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1790919666.064647:0:17050:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1790919666.064690:0:17050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17050:1877914978275968:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1790919666.064725:0:17050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.064750:0:17050:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919666.065339:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978275968 00000100:00100000:1.0:1790919666.065347:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978275968 00000100:00100000:1.0:1790919666.065471:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919666.065482:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17048:x1877914978275840:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790919666.065848:0:17711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1790919666.066027:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17048:x1877914978275840:12345-0@lo:5:osp-pre-0-1.0 Request processed in 547us (19267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.066040:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919666.066078:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919666.066090:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17050:x1877914978275968:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1790919666.066105:0:17711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1790919666.066150:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17050:x1877914978275968:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919666.066155:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919666.066207:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17048:1877914978275840:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790919666.066218:0:17048:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1790919666.066321:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17048:1877914978276096:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790919666.066357:0:17048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.066375:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70240 going to sleep for 11 seconds 00010000:00080000:1.0:1790919666.066472:0:17050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54b100 x1877914978275968/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790919682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919666.066493:0:17050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17050:1877914978275968:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790919666.066502:0:17050:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1790919666.066680:0:17050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17050:1877914978276224:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1790919666.068538:0:17050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.070812:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276096 00000100:00100000:1.0:1790919666.070827:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276096 00000100:00100000:1.0:1790919666.070866:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276224 00000100:00100000:1.0:1790919666.070869:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276224 00000100:00100000:1.0:1790919666.070900:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919666.070910:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17048:x1877914978276096:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790919666.070960:0:17714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00002000:00010000:2.0:1790919666.075999:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.076011:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.076028:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.076033:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.076038:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.076075:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.076114:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.076123:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.078153:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919666.078382:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919666.078391:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.078402:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860eee00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.078407:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.078424:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.078447:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.078455:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afffe2ed/0x951c50ad15914abf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.078474:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.078476:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.078478:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919666.080246:0:17050:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00002000:00010000:2.0:1790919666.081431:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.081442:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.081458:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.081551:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.081558:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.081574:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.081584:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.081594:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.081612:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919666.082405:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.082413:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.082425:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.082429:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.082434:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.082443:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.082452:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.082465:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.082563:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790919666.082756:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919666.082763:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082771:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919666.082776:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082786:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082813:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082820:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ea84b0/0x951c50ad15914ac6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082837:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919666.082841:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082847:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919666.082850:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082857:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082866:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082873:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d263340/0x951c50ad15914acd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.082956:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.082958:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.082965:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.083262:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.083269:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083279:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.083282:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.083287:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083296:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083305:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083312:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083330:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.083338:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.083342:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083355:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ef200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.083359:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083365:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083375:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083382:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004386a1b8/0x951c50ad15914ad4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.083396:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.083398:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.083401:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.084460:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.084548:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084562:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.084565:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.084570:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084580:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084595:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084602:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084619:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.084628:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.084633:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084640:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.084644:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084653:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084666:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084673:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914adb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.084688:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.084695:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.084697:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.085376:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.085384:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085394:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.085397:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.085402:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085412:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085419:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085426:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085440:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.085448:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.085453:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085460:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.085464:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085565:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085577:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085584:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914ae2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.085597:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.085600:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.085602:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.085604:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.089134:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.089146:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089161:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.089165:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.089172:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089184:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089194:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089207:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089225:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.089238:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.089244:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089252:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.089256:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089265:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089280:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089287:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914ae9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089303:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.089304:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.089306:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.089850:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.089864:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089873:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.089877:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.089880:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089889:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089897:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089903:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.089924:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919666.091077:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.091089:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091103:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.091107:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.091111:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091123:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091140:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091148:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091161:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919666.091432:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919666.091440:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.091684:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.091690:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.091700:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.091717:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.091735:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba9d1f83/0x951c50ad15914af0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919666.091800:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.091806:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091814:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.091817:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.091822:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091831:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091838:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091845:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091870:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790919666.091892:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919666.091898:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091905:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.091908:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091916:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091927:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.091935:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914af7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.093692:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.093702:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.093712:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.093718:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.093740:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.093757:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.093765:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914afe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.093784:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.093788:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.093791:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.094681:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.094691:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094705:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.094709:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.094714:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094726:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094736:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094750:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094770:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.094783:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.094788:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094795:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.094799:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094808:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094820:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094829:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.094847:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.094849:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.094851:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.096121:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.096140:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.096153:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.096157:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.096162:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.096264:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.096273:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.096281:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.097664:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.097806:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.097820:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.097828:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.097840:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.097845:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.097854:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.097864:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.097867:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.097869:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.098937:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.098956:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.098981:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.098983:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.098985:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.099827:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.099835:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.099849:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.099853:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.099859:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.099872:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.099881:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.099890:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.099918:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919666.100397:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919666.100405:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.100414:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.100419:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.100428:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.100444:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.100452:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a5d1f8/0x951c50ad15914b13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.100468:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.100470:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.100478:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.100549:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.100555:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100564:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.100568:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.100572:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100582:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100589:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100595:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100611:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.100622:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.100627:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100634:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.100644:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100653:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100666:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100673:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.100689:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.100692:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.100694:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.101546:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.101555:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.101565:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.101568:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.101573:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.101584:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.101593:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.101607:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.101630:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919666.101680:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919666.101686:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.101694:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919666.101697:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.101706:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.101719:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.101726:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009d56633/0x951c50ad15914b21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.101740:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.101741:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.101743:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.102241:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.102248:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.102259:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.102262:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.102267:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.103011:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.103021:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.103029:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.103045:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919666.104070:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.104081:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104103:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.104107:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.104113:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104125:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104133:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104142:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104159:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790919666.104171:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919666.104177:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104185:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.104190:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104200:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104227:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104234:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104253:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.104256:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104262:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.104265:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104273:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104283:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104290:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104301:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.104302:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.104310:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.104911:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.104919:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104928:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.104933:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.104937:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104946:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104955:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104962:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.104978:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919666.105668:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919666.105676:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.105687:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697e00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919666.105692:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.105713:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.105730:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.105738:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0b70a4/0x951c50ad15914b36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.105759:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.105762:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.105764:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.106162:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.107725:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.107738:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107755:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.107760:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.107767:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107793:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107803:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107812:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107829:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.107840:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.107845:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107853:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.107858:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107867:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107881:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107888:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.107911:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.107912:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.107914:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.108372:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.108379:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.108388:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.108391:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.108395:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.108404:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.108820:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.108830:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.108892:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919666.108946:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919666.108953:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.108960:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919666.108964:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.108972:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.108986:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.109003:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.109022:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.109024:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919666.109026:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.114271:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.114285:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114315:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.114320:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.114326:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114340:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114350:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114358:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114382:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919666.114515:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919666.114522:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.114529:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.114533:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.114542:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.114559:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.114567:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.114585:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.114587:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.114588:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.114868:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.114874:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114883:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.114886:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.114890:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114900:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114918:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114926:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114940:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919666.114950:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.114955:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114963:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.114966:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114975:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114986:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.114993:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.115007:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.115013:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.115015:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790919666.116599:0:7248:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1790919666.116613:0:7248:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00010000:2.0:1790919666.117838:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.117850:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.117867:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.117871:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.117877:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.117891:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.117902:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.117911:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.117936:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790919666.118412:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.118420:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.118429:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.118440:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.118445:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.118456:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.118464:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.118472:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.118986:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790919666.119752:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.119761:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119774:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.119778:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.119783:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119795:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119804:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119819:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119838:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790919666.119851:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790919666.119857:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119865:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.119870:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119880:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119896:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119905:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5b6c16/0x951c50ad15914b59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119926:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919666.119930:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119948:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.119951:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.119958:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.120043:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919666.120066:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.120074:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.120078:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.120094:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.120108:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.120117:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020c9e874/0x951c50ad15914b67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.120134:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.120136:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.120138:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.120152:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.125109:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.125126:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000236551e5/0x951c50ad15914b60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.125150:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.125153:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.125156:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919666.126089:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:17048:x1877914978276096:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55175us (59725us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790919666.126101:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1790919666.126156:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:1.0:1790919666.126158:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17048:1877914978276096:0@lo:5:osp-pre-0-1.0 00010000:00010000:2.0:1790919666.126167:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790919666.126175:0:17048:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1790919666.126183:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.126189:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.126195:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126208:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.126219:0:17048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17048:1877914978276352:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1790919666.126232:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126241:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126258:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790919666.126264:0:17048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.126291:0:17048:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919666.126332:0:16418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276352 00010000:00010000:0.0:1790919666.126334:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1790919666.126339:0:16418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276352 00010000:00010000:0.0:1790919666.126343:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.126352:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.126357:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.126366:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.126381:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.126384:0:16418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919666.126398:0:16418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17048:x1877914978276352:12345-0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1790919666.126406:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575e8b99/0x951c50ad15914b6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.126429:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.126431:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.126433:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919666.126477:0:16418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17048:x1877914978276352:12345-0@lo:900:osp-pre-0-1.0 Request processed in 83us (212us total) trans 0 rc 0/0 00010000:00080000:0.0:1790919666.126527:0:17048:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d54a300 x1877914978276352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919666.126538:0:17048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17048:1877914978276352:0@lo:900:osp-pre-0-1.0 00002000:00010000:2.0:1790919666.126758:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.126765:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126774:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.126778:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.126781:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126790:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126798:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126806:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.126839:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790919666.127275:0:16418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1790919666.127359:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919666.127365:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.127373:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919666.127377:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.127386:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.127399:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.127406:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb374c0/0x951c50ad15914b75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.127433:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.127435:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919666.127437:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919666.127795:0:17918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790919666.127803:0:17918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127813:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1790919666.127817:0:17918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919666.127821:0:17918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.127825:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1790919666.127837:0:17918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.127841:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17050:x1877914978276224:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1790919666.127854:0:17918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127862:0:17918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127879:0:17918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1790919666.127888:0:17714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:2.0:1790919666.127889:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919666.127896:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127904:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919666.127914:0:18447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127923:0:18447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127937:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127944:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0fc1ab/0x951c50ad15914b7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919666.127959:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.127960:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919666.127962:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1790919666.128384:0:17918:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1790919666.128460:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:16433:x1877914978275200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 98328us (99373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919666.128468:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919666.128912:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16433:1877914978275200:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790919666.128930:0:16433:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1790919666.128978:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16433:1877914978276480:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790919666.129018:0:16433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919666.129045:0:16433:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ae854240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919666.129150:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276480 00000100:00100000:2.0:1790919666.129157:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276480 00000100:00100000:2.0:1790919666.129205:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919666.129214:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:16433:x1877914978276480:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790919666.129246:0:17711:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000004:00080000:1.0:1790919666.138501:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1790919666.141134:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:16433:x1877914978276480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11914us (12108us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790919666.141146:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790919666.143912:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16433:1877914978276480:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790919666.143933:0:16433:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:0.0:1790919666.157105:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:17050:x1877914978276224:12345-0@lo:5:osp-pre-1-1.0 Request processed in 29261us (88565us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790919666.157119:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790919666.157201:0:17050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17050:1877914978276224:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790919666.157219:0:17050:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790919666.157262:0:17050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17050:1877914978276608:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790919666.157299:0:17050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.157331:0:17050:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00000100:00100000:0.0:1790919666.157598:0:16418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276608 00000100:00100000:0.0:1790919666.157672:0:16418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276608 00000100:00100000:0.0:1790919666.157717:0:16418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919666.157726:0:16418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17050:x1877914978276608:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790919666.157781:0:16418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17050:x1877914978276608:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919666.157790:0:16418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790919666.162768:0:17050:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285a9aa00 x1877914978276608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919666.162785:0:17050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17050:1877914978276608:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1790919666.332813:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919666.589351:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919666.589384:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978276736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919666.589450:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919666.589651:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276736 00000100:00100000:3.0:1790919666.589658:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276736 00000100:00100000:3.0:1790919666.589710:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919666.589719:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978276736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919666.589740:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919666.589783:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978276736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919666.589789:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919666.589868:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978276736:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1790919666.717564:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790919666.717571:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f391982800 from 10 10000000:01000000:0.0:1790919666.717577:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919666.717620:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.717632:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.717655:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919666.717692:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978276864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919666.717758:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919666.717810:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6816780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919666.717932:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276864 00000100:00100000:2.0:1790919666.717939:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276864 00000100:00100000:0.0:1790919666.718200:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790919666.718212:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978276864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919666.718227:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919666.718241:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014000/0x951c50ad15914b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914b83 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.718265:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014000/0x951c50ad15914b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914b83 expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.718275:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014000/0x951c50ad15914b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914b83 expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919666.718284:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014000, rc 0) 00000100:00100000:0.0:1790919666.718339:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978276864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919666.718347:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919666.720843:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978276864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919666.720871:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919666.720884:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.720962:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978276992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790919666.721021:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.721097:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919666.725217:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978276992 00000100:00100000:3.0:1790919666.725234:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978276992 00000100:00100000:3.0:1790919666.725302:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790919666.725312:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978276992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790919666.725339:0:16400:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790919666.725368:0:16400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790919666.725372:0:16400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1790919666.725515:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978276992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919666.725532:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790919666.725748:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978276992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790919666.725821:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919666.725831:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919666.725841:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919666.725852:0:16403:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790919666.725854:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3aee80800 from 10 10000000:01000000:1.0:1790919666.725857:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790919666.725885:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919666.725893:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919666.725902:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.725921:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978277120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919666.725954:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.725993:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919666.726178:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277120 00000100:00100000:3.0:1790919666.726184:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277120 00000100:00100000:3.0:1790919666.726220:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790919666.726227:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978277120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919666.726237:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919666.726250:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2d000/0x951c50ad15914b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914b91 expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.726271:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2d000/0x951c50ad15914b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914b91 expref: 24 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.726281:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2d000/0x951c50ad15914b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914b91 expref: 24 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919666.726290:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2d000, rc 0) 00000100:00100000:3.0:1790919666.726325:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978277120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919666.726331:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790919666.726470:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978277120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919666.726494:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919666.726503:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919666.726558:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978277248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790919666.726591:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919666.726619:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bce70480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919666.726661:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277248 00000100:00100000:3.0:1790919666.726666:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277248 00000100:00100000:3.0:1790919666.726704:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790919666.726711:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978277248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790919666.726723:0:16400:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790919666.726737:0:16400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790919666.726741:0:16400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1790919666.726817:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978277248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919666.726833:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790919666.726943:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978277248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790919666.726988:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919666.726994:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919666.727001:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919667.104391:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978277376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919667.104464:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919667.104567:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277376 00000100:00100000:1.0:1790919667.104574:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277376 00000100:00100000:1.0:1790919667.104617:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919667.104625:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978277376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919667.104661:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919667.104703:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978277376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919667.104711:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919667.104732:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978277504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919667.104755:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919667.104797:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978277376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919667.104835:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277504 00000100:00100000:1.0:1790919667.104838:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277504 00000100:00100000:1.0:1790919667.104855:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919667.104861:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978277504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919667.104889:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919667.104923:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978277504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919667.104929:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919667.104955:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978277504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790919667.364628:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919668.380149:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919668.731612:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1790919668.731629:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1790919669.408809:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790919670.283579:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:0.0:1790919670.283602:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790919670.283608:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790919670.283615:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1790919670.434682:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919671.038598:0:18791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790919671.200813:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f28559bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978277632:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.200896:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.200941:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978278144:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.200968:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.200988:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978278656:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201008:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201025:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978279168:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201046:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201089:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790919671.201095:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978277760:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201118:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201135:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978278272:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201152:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201164:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978278784:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201182:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201205:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978277888:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201228:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201245:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978278400:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201264:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201279:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978278912:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201315:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201330:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790919671.201336:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978278016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201356:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201379:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978278528:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201404:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201421:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978279040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201462:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.201510:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277632 00000100:00100000:0.0:1790919671.201518:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277632 00000100:00100000:0.0:1790919671.201561:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790919671.201570:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3458:x1877914978277632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201624:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3458:x1877914978277632:12345-0@lo:400:kworker.0 Request processed in 55us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.201632:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790919671.201665:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278144 00000100:00100000:0.0:1790919671.201669:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278144 00000100:00100000:0.0:1790919671.201688:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278656 00000100:00100000:0.0:1790919671.201691:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278656 00000100:00100000:0.0:1790919671.201702:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279168 00000100:00100000:0.0:1790919671.201704:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279168 00000100:00100000:0.0:1790919671.201723:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278784 00000100:00100000:0.0:1790919671.201725:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278784 00000100:00100000:0.0:1790919671.201734:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278912 00000100:00100000:0.0:1790919671.201736:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278912 00000100:00100000:0.0:1790919671.201745:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279040 00000100:00100000:0.0:1790919671.201746:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279040 00000100:00100000:0.0:1790919671.201756:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919671.201761:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978278144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201801:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978278144:12345-0@lo:400:kworker.0 Request processed in 39us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.201808:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919671.201820:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919671.201826:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978278656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201849:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978278656:12345-0@lo:400:kworker.0 Request processed in 23us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.201854:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790919671.201864:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790919671.201868:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978279168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201899:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978279168:12345-0@lo:400:kworker.0 Request processed in 25us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.201905:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790919671.201917:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919671.201924:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978278784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.201953:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978278784:12345-0@lo:400:kworker.0 Request processed in 30us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.201959:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919671.201970:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919671.201976:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978278912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202007:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978278912:12345-0@lo:400:kworker.0 Request processed in 32us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202013:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919671.202023:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919671.202029:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978279040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202086:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978279040:12345-0@lo:400:kworker.0 Request processed in 58us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202093:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919671.202117:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277760 00000100:00100000:0.0:1790919671.202121:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277760 00000100:00100000:0.0:1790919671.202139:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278272 00000100:00100000:0.0:1790919671.202142:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278272 00000100:00100000:0.0:1790919671.202156:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919671.202163:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978277760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202195:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978277760:12345-0@lo:400:kworker.0 Request processed in 33us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202201:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919671.202213:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790919671.202219:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978278272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202247:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978278272:12345-0@lo:400:kworker.0 Request processed in 28us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202252:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790919671.202271:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978277888 00000100:00100000:0.0:1790919671.202274:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978277888 00000100:00100000:0.0:1790919671.202290:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278400 00000100:00100000:0.0:1790919671.202293:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278400 00000100:00100000:0.0:1790919671.202304:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278016 00000100:00100000:0.0:1790919671.202307:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278016 00000100:00100000:0.0:1790919671.202316:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978278528 00000100:00100000:0.0:1790919671.202318:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978278528 00000100:00100000:0.0:1790919671.202331:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919671.202336:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978277888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202367:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978277888:12345-0@lo:400:kworker.0 Request processed in 30us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202380:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919671.202393:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919671.202399:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978278400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202424:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978278400:12345-0@lo:400:kworker.0 Request processed in 26us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202429:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919671.202438:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919671.202444:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978278016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202482:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978278016:12345-0@lo:400:kworker.0 Request processed in 38us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202487:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919671.202498:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919671.202503:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978278528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.202528:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978278528:12345-0@lo:400:kworker.0 Request processed in 24us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202533:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919671.202583:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978279296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919671.202611:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.202644:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919671.202652:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978279424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919671.202674:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919671.202704:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279296 00000100:00100000:0.0:1790919671.202707:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279296 00000100:00100000:0.0:1790919671.202721:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279424 00000100:00100000:0.0:1790919671.202723:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279424 00000100:00100000:0.0:1790919671.202742:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919671.202748:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978279296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919671.202773:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919671.202807:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978279296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202814:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919671.202825:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919671.202831:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978279424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919671.202847:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919671.202875:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978279424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919671.202881:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919671.203172:0:3461:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790919671.203195:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978279424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919671.203222:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790919671.203234:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978279296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919671.203268:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790919671.203280:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978278016:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.203291:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978278528:0@lo:400:kworker.0 00010000:00080000:0.0:1790919671.203304:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fdc00 x1877914978279040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919671.203316:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978279040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.203328:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978277888:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.203352:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978278400:0@lo:400:kworker.0 00010000:00080000:0.0:1790919671.203365:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fdf80 x1877914978278912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919671.203373:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978278912:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.203426:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978277760:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.203442:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978278272:0@lo:400:kworker.0 00000100:00080000:2.0:1790919671.206988:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919671.206999:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919671.207003:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919671.207006:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919671.207235:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978279552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919671.207305:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919671.207365:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279552 00000100:00100000:2.0:1790919671.207373:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279552 00000100:00100000:2.0:1790919671.207415:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919671.207424:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978279552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919671.207463:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919671.207510:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978279552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919671.207518:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919671.207563:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978279552:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790919671.209358:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285aab100 x1877914978278784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919671.209378:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978278784:0@lo:400:kworker.0 00000100:00100000:0.0:1790919671.209390:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f28559bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978277632:0@lo:400:kworker.0 00010000:00080000:0.0:1790919671.209402:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285aaaa00 x1877914978278144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919671.209411:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978278144:0@lo:400:kworker.0 00010000:00080000:0.0:1790919671.209422:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285aa8000 x1877914978278656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919671.209430:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978278656:0@lo:400:kworker.0 00010000:00080000:0.0:1790919671.209442:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2860fd880 x1877914978279168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919671.210924:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978279168:0@lo:400:kworker.0 00010000:00010000:2.0:1790919671.452244:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919671.708784:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978279680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919671.708869:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919671.709019:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279680 00000100:00100000:3.0:1790919671.709027:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279680 00000100:00100000:3.0:1790919671.709114:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919671.709124:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978279680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790919671.709148:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919671.709204:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978279680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919671.709211:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919671.709735:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978279680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919672.220327:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978279808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919672.220394:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919672.220480:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279808 00000100:00100000:3.0:1790919672.220488:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279808 00000100:00100000:3.0:1790919672.220531:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919672.220553:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978279808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919672.220595:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919672.220640:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978279808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919672.220648:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790919672.220694:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978279808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919672.220998:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919672.221008:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978279936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919672.221041:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919672.221688:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978279936 00000100:00100000:3.0:1790919672.221696:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978279936 00000100:00100000:3.0:1790919672.221739:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919672.221747:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978279936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919672.221780:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919672.221862:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978279936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919672.221868:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919672.221905:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978279936:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790919672.477407:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919672.797718:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790919673.121533:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.121603:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281344 00000100:00100000:2.0:1790919673.121614:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281344 00000100:00100000:2.0:1790919673.121678:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:2.0:1790919673.121686:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2410:x1877914958281344:12345-192.168.203.11@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790919673.121713:0:16401:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 24ec2864-d240-484b-9820-6394233cc11c@192.168.203.11@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1790919673.121741:0:16401:0:(genops.c:1384:class_connect()) connect: client 24ec2864-d240-484b-9820-6394233cc11c, cookie 0x951c50ad15914b9f 00000100:00080000:2.0:1790919673.121892:0:16401:0:(import.c:65:import_set_state_nolock()) ffff95f28400e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919673.121962:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+5:2410:x1877914958281344:12345-192.168.203.11@tcp:250:mount.lustre.0 Request processed in 275us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919673.121971:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:2.0:1790919673.126382:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.126546:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281472 00000100:00100000:3.0:1790919673.126557:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281472 00000100:00100000:3.0:1790919673.126646:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:3.0:1790919673.126658:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+5:15014:x1877914958281472:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790919673.126675:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919673.126694:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2de00/0x951c50ad15914ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38fa4 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919673.126722:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2de00/0x951c50ad15914ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fa4 expref: 6 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919673.126733:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2de00/0x951c50ad15914ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fa4 expref: 6 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919673.126742:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2de00, rc 0) 00000100:00100000:3.0:1790919673.126813:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+6:15014:x1877914958281472:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 150us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.126821:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1790919673.130555:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919673.130667:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281600 00000100:00100000:0.0:1790919673.130676:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281600 00000100:00100000:0.0:1790919673.130733:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:0.0:1790919673.130743:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+6:15014:x1877914958281600:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790919673.131323:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+6:15014:x1877914958281600:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 578us (775us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919673.131332:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:2.0:1790919673.133969:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.134044:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281728 00000100:00100000:3.0:1790919673.134077:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281728 00000100:00100000:3.0:1790919673.134126:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1790919673.134135:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+6:15014:x1877914958281728:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790919673.134151:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919673.134185:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2ce00/0x951c50ad15914bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38fab expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919673.134217:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2ce00/0x951c50ad15914bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fab expref: 7 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919673.134229:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2ce00/0x951c50ad15914bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fab expref: 7 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919673.134255:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2ce00, rc 0) 00000100:00100000:3.0:1790919673.134326:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+7:15014:x1877914958281728:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 192us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.134334:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:2.0:1790919673.136223:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.136469:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281856 00000100:00100000:3.0:1790919673.136477:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281856 00000100:00100000:3.0:1790919673.136528:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:3.0:1790919673.136536:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+7:15014:x1877914958281856:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790919673.136894:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+8:15014:x1877914958281856:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 356us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.136902:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:2.0:1790919673.142330:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919673.142429:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958281984 00000100:00100000:0.0:1790919673.142450:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958281984 00000100:00100000:0.0:1790919673.142509:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:0.0:1790919673.142520:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+8:15014:x1877914958281984:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919673.142818:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+8:15014:x1877914958281984:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 299us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.142827:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:2.0:1790919673.145911:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.146033:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282112 00000100:00100000:3.0:1790919673.146042:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282112 00000100:00100000:3.0:1790919673.146111:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:3.0:1790919673.146122:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+8:15033:x1877914958282112:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919673.147456:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+8:15033:x1877914958282112:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 1330us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.147468:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1790919673.187121:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.187185:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282240 00000100:00100000:2.0:1790919673.187195:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282240 00000100:00100000:2.0:1790919673.187245:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:2.0:1790919673.187254:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+8:15033:x1877914958282240:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919673.187602:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+8:15033:x1877914958282240:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 342us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919673.187611:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:2.0:1790919673.194106:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.194212:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282368 00000100:00100000:3.0:1790919673.194221:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282368 00000100:00100000:3.0:1790919673.194355:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:3.0:1790919673.194370:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+8:15033:x1877914958282368:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919673.194625:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+8:15033:x1877914958282368:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 257us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.194633:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790919673.199486:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.199621:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282496 00000100:00100000:2.0:1790919673.199631:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282496 00000100:00100000:2.0:1790919673.199686:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:2.0:1790919673.199719:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+8:15014:x1877914958282496:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919673.199737:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919673.199757:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381697800/0x951c50ad15914bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38fdc expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919673.199785:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697800/0x951c50ad15914bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fdc expref: 9 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919673.199795:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381697800/0x951c50ad15914bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fdc expref: 9 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919673.199804:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697800, rc 0) 00000100:00100000:2.0:1790919673.199862:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+9:15014:x1877914958282496:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 154us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919673.199869:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:1.0:1790919673.204718:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.204827:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282624 00000100:00100000:3.0:1790919673.204951:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282624 00000100:00100000:3.0:1790919673.205009:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:3.0:1790919673.205020:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+9:15014:x1877914958282624:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790919673.205045:0:16398:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790919673.205087:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790919673.205091:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790919673.205095:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790919673.205098:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790919673.205100:0:16398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1790919673.208922:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+9:15014:x1877914958282624:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 3893us (4202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.208937:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1790919673.212798:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919673.212891:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282752 00000100:00100000:0.0:1790919673.212900:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282752 00000100:00100000:0.0:1790919673.212959:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1790919673.212969:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+9:15014:x1877914958282752:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919673.212984:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919673.213001:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f38fe3 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919673.213042:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 10 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919673.213087:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 10 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919673.213097:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6014200, rc 0) 00000100:00100000:0.0:1790919673.213170:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+10:15014:x1877914958282752:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 202us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.213176:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:1.0:1790919673.218566:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919673.218759:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958282880 00000100:00100000:0.0:1790919673.218770:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958282880 00000100:00100000:0.0:1790919673.218830:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:0.0:1790919673.218839:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+10:15014:x1877914958282880:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790919673.219160:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+10:15014:x1877914958282880:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 320us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.219169:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1790919673.221627:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.221833:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283008 00000100:00100000:2.0:1790919673.221842:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283008 00000100:00100000:2.0:1790919673.221897:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:2.0:1790919673.221907:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2843b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+10:15014:x1877914958283008:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790919673.222326:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2843b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+10:15014:x1877914958283008:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 419us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919673.222334:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:1.0:1790919673.224876:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.224973:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283136 00000100:00100000:2.0:1790919673.224982:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283136 00000100:00100000:2.0:1790919673.225037:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:2.0:1790919673.225047:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+10:15037:x1877914958283136:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919673.225383:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+10:15037:x1877914958283136:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 336us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919673.225398:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:1.0:1790919673.230811:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919673.230947:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283264 00000100:00100000:0.0:1790919673.230958:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283264 00000100:00100000:0.0:1790919673.231010:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1790919673.231019:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+10:15037:x1877914958283264:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919673.231285:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+10:15037:x1877914958283264:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 266us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.231294:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:3.0:1790919673.243944:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919673.245371:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.245463:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283392 00000100:00100000:3.0:1790919673.245480:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283392 00000100:00100000:3.0:1790919673.245518:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283648 00000100:00100000:3.0:1790919673.245521:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283648 00000100:00100000:3.0:1790919673.245535:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919673.245542:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1877914958283392:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790919673.245568:0:16405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e183cc62-cefd-4e26-96c7-4234fcebe0d8@192.168.203.11@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1790919673.245618:0:16405:0:(genops.c:1384:class_connect()) connect: client e183cc62-cefd-4e26-96c7-4234fcebe0d8, cookie 0x951c50ad15914bc2 00000004:00100000:3.0:1790919673.245658:0:16405:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790919673.246000:0:16405:0:(import.c:65:import_set_state_nolock()) ffff95f398dcc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919673.246094:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2410:x1877914958283392:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 550us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.246102:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919673.246119:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919673.246125:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1877914958283648:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790919673.246141:0:16405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e183cc62-cefd-4e26-96c7-4234fcebe0d8@192.168.203.11@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1790919673.246172:0:16405:0:(genops.c:1384:class_connect()) connect: client e183cc62-cefd-4e26-96c7-4234fcebe0d8, cookie 0x951c50ad15914bc9 00000004:00100000:3.0:1790919673.246187:0:16405:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790919673.246396:0:16405:0:(import.c:65:import_set_state_nolock()) ffff95f398dcd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919673.246422:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2410:x1877914958283648:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 295us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.246428:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919673.263603:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.263647:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919673.266202:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283776 00000100:00100000:1.0:1790919673.266218:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283776 00000100:00080000:2.0:1790919673.267002:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919673.267150:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283520 00000100:00100000:1.0:1790919673.267155:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283520 00000100:00100000:1.0:1790919673.267200:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919673.267209:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:0:x1877914958283776:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790919673.267255:0:16407:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919673.267355:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:0:x1877914958283776:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 146us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919673.267363:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919673.267382:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919673.267389:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:0:x1877914958283520:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790919673.267408:0:16407:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919673.267455:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:0:x1877914958283520:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 65us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919673.267461:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:2.0:1790919673.269108:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919673.271423:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919673.271562:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958283904 00000100:00100000:1.0:1790919673.271574:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958283904 00000100:00100000:1.0:1790919673.271630:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790919673.271640:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958283904:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790919673.271673:0:16407:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919673.271815:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958283904:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 176us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919673.271823:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790919673.278691:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919673.278842:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284032 00000100:00100000:3.0:1790919673.278852:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284032 00000100:00100000:3.0:1790919673.278915:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1790919673.278925:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958284032:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790919673.279014:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958284032:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919673.279022:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790919673.281895:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.281981:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919673.282017:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919673.282106:0:16417:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284416 00000100:00100000:1.0:1790919673.282115:0:16417:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284416 00000100:00100000:1.0:1790919673.282159:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790919673.282169:0:16417:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958284416:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790919673.282270:0:16417:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958284416:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 102us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919673.282277:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919673.283961:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284160 00000100:00100000:0.0:1790919673.283985:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284160 00000100:00100000:0.0:1790919673.284171:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284288 00000100:00100000:0.0:1790919673.284175:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284288 00000100:00100000:1.0:1790919673.288474:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790919673.288486:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2410:x1877914958284160:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790919673.288531:0:17712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e183cc62-cefd-4e26-96c7-4234fcebe0d8@192.168.203.11@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1790919673.288566:0:17712:0:(genops.c:1384:class_connect()) connect: client e183cc62-cefd-4e26-96c7-4234fcebe0d8, cookie 0x951c50ad15914bd0 00002000:00100000:1.0:1790919673.288579:0:17712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e183cc62-cefd-4e26-96c7-4234fcebe0d8/ffff95f286c1a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790919673.288604:0:17712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790919673.288934:0:17712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790919673.288971:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f286c1a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919673.289159:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1790919673.289167:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2410:x1877914958284288:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790919673.289186:0:17714:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e183cc62-cefd-4e26-96c7-4234fcebe0d8@192.168.203.11@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1790919673.289204:0:17714:0:(genops.c:1384:class_connect()) connect: client e183cc62-cefd-4e26-96c7-4234fcebe0d8, cookie 0x951c50ad15914bd7 00002000:00100000:0.0:1790919673.289210:0:17714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e183cc62-cefd-4e26-96c7-4234fcebe0d8/ffff95f286ff0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790919673.289223:0:17714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790919673.289740:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2410:x1877914958284160:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 1251us (7911us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919673.289748:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00002000:00080000:0.0:1790919673.290010:0:17714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790919673.290031:0:17714:0:(import.c:65:import_set_state_nolock()) ffff95f286ff4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919673.290612:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2410:x1877914958284288:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 1440us (8590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.290620:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790919673.291621:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919673.291814:0:16409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284544 00000100:00100000:0.0:1790919673.291822:0:16409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284544 00000100:00100000:0.0:1790919673.291871:0:16409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790919673.291880:0:16409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958284544:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00080000:0.0:1790919673.301083:0:16409:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5658us 00000004:00200000:0.0:1790919673.312498:0:16409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790919673.312618:0:16409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15014:x1877914958284544:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 20734us (20996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919673.312628:0:16409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790919673.476107:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919673.476632:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284672 00000100:00100000:1.0:1790919673.476647:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284672 00000100:00100000:1.0:1790919673.476714:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790919673.476724:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15059:x1877914958284672:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:1.0:1790919673.476744:0:16407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919673.476769:0:16407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15914bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39014 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919673.476837:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914be5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919673.476869:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919673.476883:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919673.476920:0:16407:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919673.476923:0:16407:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919673.476958:0:16407:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919673.476982:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d200/0x951c50ad15914bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39014 expref: 8 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919673.477001:0:16407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39014 expref: 7 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919673.477010:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:1.0:1790919673.477013:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919673.477017:0:16407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d400, rc 0) 00000100:00100000:1.0:1790919673.477108:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15059:x1877914958284672:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 385us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919673.477115:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00010000:00010000:0.0:1790919673.500276:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790919673.852311:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000040:00080000:3.0:1790919674.012792:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919674.524287:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790919675.384401:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000100:00100000:1.0:1790919675.426949:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.427041:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284800 00000100:00100000:3.0:1790919675.427104:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284800 00000100:00100000:3.0:1790919675.427485:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790919675.427496:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15112:x1877914958284800:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:3.0:1790919675.427541:0:16408:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919675.427639:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15112:x1877914958284800:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 145us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.427647:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1790919675.433544:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.433686:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958284928 00000100:00100000:1.0:1790919675.433697:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958284928 00000100:00080000:2.0:1790919675.435685:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919675.435695:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919675.436645:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790919675.436661:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15112:x1877914958284928:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1790919675.436723:0:16407:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919675.437041:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15112:x1877914958284928:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 383us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919675.437049:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1790919675.442288:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.442383:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285056 00000100:00100000:3.0:1790919675.442392:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285056 00000100:00100000:3.0:1790919675.442505:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790919675.442516:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15112:x1877914958285056:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1790919675.442556:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919675.442635:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15112:x1877914958285056:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 121us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.442643:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1790919675.445189:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.445362:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285184 00000100:00100000:3.0:1790919675.445372:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285184 00000100:00080000:2.0:1790919675.445458:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919675.445470:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919675.445641:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1790919675.445652:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15112:x1877914958285184:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1790919675.445687:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919675.445768:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15112:x1877914958285184:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 119us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.445775:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00010000:00010000:2.0:1790919675.548232:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919675.619229:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.619695:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285312 00000100:00100000:0.0:1790919675.619709:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285312 00000100:00100000:0.0:1790919675.619770:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:0.0:1790919675.619780:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+10:15144:x1877914958285312:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919675.619796:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919675.619929:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3b6015200/0x951c50ad15914bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3901b expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919675.619964:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3b6015200/0x951c50ad15914bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3901b expref: 11 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919675.619974:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3b6015200/0x951c50ad15914bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3901b expref: 11 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919675.619983:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015200, rc 0) 00000100:00100000:0.0:1790919675.620048:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+11:15144:x1877914958285312:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 269us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.620430:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1790919675.627378:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.627489:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285440 00000100:00100000:2.0:1790919675.627499:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285440 00000100:00100000:2.0:1790919675.627557:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1790919675.627567:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+11:15144:x1877914958285440:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790919675.627858:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+11:15144:x1877914958285440:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 291us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.627866:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:1.0:1790919675.634500:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.634599:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285568 00000100:00100000:0.0:1790919675.634608:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285568 00000100:00100000:0.0:1790919675.634661:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1790919675.634671:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+11:15144:x1877914958285568:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919675.634915:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+11:15144:x1877914958285568:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 245us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.634924:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1790919675.655231:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.655466:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285696 00000100:00100000:3.0:1790919675.655476:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285696 00000100:00100000:3.0:1790919675.655532:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:3.0:1790919675.655555:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+11:15151:x1877914958285696:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790919675.655838:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+11:15151:x1877914958285696:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 284us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.655846:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:1.0:1790919675.675445:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.687223:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285824 00000100:00100000:2.0:1790919675.687237:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285824 00000100:00100000:2.0:1790919675.687309:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:2.0:1790919675.687319:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+11:15151:x1877914958285824:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919675.689425:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+11:15151:x1877914958285824:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 2089us (13972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.689439:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1790919675.695854:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.695952:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958285952 00000100:00100000:0.0:1790919675.695973:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958285952 00000100:00100000:0.0:1790919675.696025:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1790919675.696035:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+11:15151:x1877914958285952:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919675.696285:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+11:15151:x1877914958285952:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 250us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.696293:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:1.0:1790919675.699919:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.700083:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286080 00000100:00100000:2.0:1790919675.700092:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286080 00000100:00100000:2.0:1790919675.700153:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:2.0:1790919675.700163:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+11:15144:x1877914958286080:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919675.700179:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919675.700198:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381697000/0x951c50ad15914bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3904c expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919675.700226:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697000/0x951c50ad15914bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3904c expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919675.700237:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381697000/0x951c50ad15914bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3904c expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919675.700246:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697000, rc 0) 00000100:00100000:2.0:1790919675.700305:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+12:15144:x1877914958286080:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 143us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.700312:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:1.0:1790919675.703037:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.703147:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286208 00000100:00100000:3.0:1790919675.703157:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286208 00000100:00100000:3.0:1790919675.703207:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:3.0:1790919675.703217:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+12:15144:x1877914958286208:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790919675.703241:0:16398:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790919675.703264:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790919675.703269:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790919675.703272:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790919675.703275:0:16398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790919675.703277:0:16398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1790919675.704780:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+12:15144:x1877914958286208:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 1556us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.704794:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:1.0:1790919675.707907:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.708045:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286336 00000100:00100000:0.0:1790919675.708077:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286336 00000100:00100000:2.0:1790919675.708241:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:2.0:1790919675.708252:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+12:15144:x1877914958286336:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919675.708269:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919675.708286:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39053 expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919675.708332:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 13 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919675.708343:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 13 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919675.708352:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919675.708408:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15144:x1877914958286336:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 158us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.708425:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:1.0:1790919675.710888:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.710983:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286464 00000100:00100000:3.0:1790919675.710992:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286464 00000100:00100000:3.0:1790919675.711118:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:3.0:1790919675.711146:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:15144:x1877914958286464:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790919675.711478:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:15144:x1877914958286464:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 349us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.711486:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:1.0:1790919675.714120:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.714558:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286592 00000100:00100000:0.0:1790919675.714569:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286592 00000100:00100000:0.0:1790919675.714667:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:0.0:1790919675.714679:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+13:15144:x1877914958286592:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919675.714903:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+13:15144:x1877914958286592:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 226us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.714910:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:1.0:1790919675.717699:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.718678:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286720 00000100:00100000:2.0:1790919675.718690:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286720 00000100:00100000:2.0:1790919675.718737:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:2.0:1790919675.718746:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15157:x1877914958286720:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919675.719023:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15157:x1877914958286720:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 277us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.719031:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:1.0:1790919675.732427:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.732573:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286848 00000100:00100000:2.0:1790919675.732584:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286848 00000100:00100000:2.0:1790919675.732633:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:2.0:1790919675.732642:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15157:x1877914958286848:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919675.732908:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15157:x1877914958286848:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 265us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.732916:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:1.0:1790919675.750745:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.750777:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.750809:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.750903:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.750928:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.750932:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958286976 00000100:00100000:2.0:1790919675.750957:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958286976 00000100:00100000:1.0:1790919675.750962:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.750991:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287872 00000100:00100000:2.0:1790919675.750992:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287232 00000100:00100000:1.0:1790919675.750996:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287872 00000100:00100000:2.0:1790919675.750998:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287232 00000100:00100000:2.0:1790919675.751011:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287616 00000100:00100000:2.0:1790919675.751013:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287616 00000100:00100000:1.0:1790919675.751035:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288000 00000100:00100000:2.0:1790919675.751038:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287744 00000100:00100000:1.0:1790919675.751040:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288000 00000100:00100000:2.0:1790919675.751043:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287744 00000100:00100000:2.0:1790919675.751095:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790919675.751108:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2411:x1877914958287616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919675.751115:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919675.751135:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2411:x1877914958287872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919675.751196:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2411:x1877914958287872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919675.751203:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919675.751219:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790919675.751224:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2411:x1877914958288000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919675.751247:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2411:x1877914958288000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919675.751253:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919675.751310:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2411:x1877914958287616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 205us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.751318:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790919675.751334:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1790919675.751342:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2411:x1877914958287744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919675.751347:0:16408:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790919675.751358:0:16408:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790919675.751497:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790919675.751503:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2410:x1877914958286976:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790919675.751526:0:16408:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b540191a-9155-42a4-9bf1-c88998854efa@192.168.203.11@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1790919675.751563:0:16408:0:(genops.c:1384:class_connect()) connect: client b540191a-9155-42a4-9bf1-c88998854efa, cookie 0x951c50ad15914c01 00000004:00100000:0.0:1790919675.751595:0:16408:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1790919675.758619:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2411:x1877914958287744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7108us (7522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.758635:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1790919675.766573:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790919675.766586:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2410:x1877914958287232:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790919675.766618:0:18910:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from b540191a-9155-42a4-9bf1-c88998854efa@192.168.203.11@tcp t0 exp 0000000000000000 cur 484 last 0 00000100:00080000:1.0:1790919675.767466:0:16408:0:(import.c:65:import_set_state_nolock()) ffff95f286ff1800 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1790919675.767673:0:18910:0:(genops.c:1384:class_connect()) connect: client b540191a-9155-42a4-9bf1-c88998854efa, cookie 0x951c50ad15914c08 00000004:00100000:0.0:1790919675.767709:0:18910:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790919675.767839:0:18910:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7e9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919675.767952:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:2410:x1877914958286976:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 16446us (17216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919675.767962:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1790919675.768347:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:2410:x1877914958287232:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 1759us (17566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.768354:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790919675.776367:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.776486:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.776747:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287360 00000100:00100000:3.0:1790919675.776757:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287360 00000100:00080000:0.0:1790919675.776830:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919675.776849:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287104 00000100:00100000:3.0:1790919675.776854:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287104 00000100:00100000:3.0:1790919675.776886:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790919675.776895:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:0:x1877914958287360:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790919675.776926:0:16405:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1790919675.777040:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919675.777079:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790919675.777090:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:0:x1877914958287104:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790919675.777105:0:18910:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919675.777151:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:0:x1877914958287104:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 64us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.777159:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1790919675.777931:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:0:x1877914958287360:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 1034us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.777941:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790919675.782536:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.783317:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958287488 00000100:00100000:0.0:1790919675.783333:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958287488 00000100:00100000:0.0:1790919675.783404:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790919675.783424:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958287488:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790919675.783464:0:16408:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919675.783537:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958287488:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 123us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.783544:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1790919675.787246:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919675.787389:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288128 00000100:00100000:3.0:1790919675.787399:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288128 00000100:00100000:3.0:1790919675.787470:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790919675.787479:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958288128:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790919675.787573:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958288128:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.787580:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790919675.791093:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.791585:0:16417:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288512 00000100:00100000:0.0:1790919675.791595:0:16417:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288512 00000100:00100000:0.0:1790919675.791669:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1790919675.791679:0:16417:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958288512:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790919675.792990:0:16417:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958288512:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 1305us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.793004:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790919675.793438:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919675.793592:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919675.794536:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288256 00000100:00100000:0.0:1790919675.794546:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288256 00000100:00100000:0.0:1790919675.794578:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288384 00000100:00100000:0.0:1790919675.794581:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288384 00000100:00100000:0.0:1790919675.794596:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790919675.794603:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2410:x1877914958288256:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790919675.794651:0:17714:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b540191a-9155-42a4-9bf1-c88998854efa@192.168.203.11@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1790919675.794681:0:17714:0:(genops.c:1384:class_connect()) connect: client b540191a-9155-42a4-9bf1-c88998854efa, cookie 0x951c50ad15914c0f 00002000:00100000:0.0:1790919675.794692:0:17714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b540191a-9155-42a4-9bf1-c88998854efa/ffff95f3bd7e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790919675.794703:0:17714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790919675.794867:0:17714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919675.794895:0:17714:0:(import.c:65:import_set_state_nolock()) ffff95f283a03000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919675.795694:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1790919675.795704:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2410:x1877914958288384:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790919675.795730:0:17712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b540191a-9155-42a4-9bf1-c88998854efa@192.168.203.11@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1790919675.795760:0:17712:0:(genops.c:1384:class_connect()) connect: client b540191a-9155-42a4-9bf1-c88998854efa, cookie 0x951c50ad15914c16 00002000:00100000:3.0:1790919675.795769:0:17712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b540191a-9155-42a4-9bf1-c88998854efa/ffff95f3b65b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790919675.795776:0:17712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790919675.796398:0:17712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790919675.796437:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f386d98800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919675.796584:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:2410:x1877914958288256:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 1978us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919675.796593:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1790919675.801556:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b540191a-9155-42a4-9bf1-c88998854efa+6:2410:x1877914958288384:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 5839us (7951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919675.801588:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790919675.801607:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919675.802116:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288640 00000100:00100000:2.0:1790919675.802125:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288640 00000100:00100000:2.0:1790919675.802799:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790919675.802808:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958288640:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790919675.802890:0:16410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790919675.803123:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b540191a-9155-42a4-9bf1-c88998854efa+6:15144:x1877914958288640:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 315us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919675.803141:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790919676.017266:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919676.017521:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288768 00000100:00100000:1.0:1790919676.017532:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288768 00000100:00100000:1.0:1790919676.017595:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1790919676.017607:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:15180:x1877914958288768:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:1.0:1790919676.017647:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919676.017668:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15914c1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39084 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919676.017854:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919676.017869:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919676.017881:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919676.017914:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919676.017918:0:16408:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919676.017937:0:16408:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919676.017962:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c800/0x951c50ad15914c1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 8 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919676.017980:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 7 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919676.017990:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:1.0:1790919676.017993:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919676.017996:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c000, rc 0) 00000100:00100000:1.0:1790919676.018100:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28559bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+7:15180:x1877914958288768:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 496us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919676.018117:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919676.316319:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978280064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919676.316397:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919676.316498:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280064 00000100:00100000:0.0:1790919676.316506:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280064 00000100:00100000:0.0:1790919676.316556:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919676.316565:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978280064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919676.316599:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919676.316646:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978280064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919676.316654:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790919676.316674:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919676.316710:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978280064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919676.316979:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978280320:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317016:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317044:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978280832:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317093:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317111:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978281344:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317133:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317163:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790919676.317169:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978280192:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317202:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317224:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978280704:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317247:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317263:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978281216:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317286:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317313:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280320 00000100:00100000:3.0:1790919676.317317:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280320 00000100:00100000:3.0:1790919676.317338:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280832 00000100:00100000:3.0:1790919676.317342:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280832 00000100:00100000:3.0:1790919676.317355:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919676.317361:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978280320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317393:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978280320:12345-0@lo:400:kworker.0 Request processed in 32us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919676.317397:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919676.317407:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919676.317423:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978280832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317465:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978280832:12345-0@lo:400:kworker.0 Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919676.317470:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919676.317489:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978280448:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317516:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317534:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978280960:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317554:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317568:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978281472:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317588:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317604:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790919676.317610:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978280576:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317638:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317652:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978281088:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317671:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.317682:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978281600:0@lo:400:kworker.0 00000100:00100000:1.0:1790919676.317691:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281344 00000100:00100000:1.0:1790919676.317696:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281344 00000100:00100000:3.0:1790919676.317700:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919676.317712:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919676.317729:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978280320:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.317738:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978280832:0@lo:400:kworker.0 00000100:00100000:1.0:1790919676.317744:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280704 00000100:00100000:1.0:1790919676.317746:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280704 00000100:00100000:3.0:1790919676.317750:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919676.317756:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978281728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919676.317756:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281216 00000100:00100000:1.0:1790919676.317759:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281216 00000100:00080000:1.0:1790919676.317770:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919676.317779:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919676.317782:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281472 00000100:00100000:1.0:1790919676.317784:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281472 00000100:00100000:3.0:1790919676.317801:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281088 00000100:00100000:3.0:1790919676.317804:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281088 00000100:00080000:1.0:1790919676.317806:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919676.317830:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281600 00000100:00100000:1.0:1790919676.317833:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281600 00000100:00080000:1.0:1790919676.317843:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919676.317856:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919676.317862:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978281344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919676.317903:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978281344:12345-0@lo:400:kworker.0 Request processed in 41us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919676.317909:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790919676.317933:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845a8a80 x1877914978281344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919676.317944:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978281344:0@lo:400:kworker.0 00000100:00100000:1.0:1790919676.317962:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919676.318229:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280448 00000100:00100000:2.0:1790919676.318235:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280448 00000100:00100000:2.0:1790919676.318284:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280960 00000100:00100000:2.0:1790919676.318288:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280960 00000100:00100000:2.0:1790919676.318300:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280576 00000100:00100000:2.0:1790919676.318302:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280576 00000100:00100000:2.0:1790919676.318315:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919676.318320:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978280448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.318359:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978280448:12345-0@lo:400:kworker.0 Request processed in 38us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.318365:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919676.318377:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919676.318382:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978280960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.318405:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978280960:12345-0@lo:400:kworker.0 Request processed in 24us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.318420:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919676.318431:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919676.318437:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978280576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.318468:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978280576:12345-0@lo:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.318474:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790919676.318557:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790919676.318561:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919676.318913:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919676.318921:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978281216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.318956:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978281216:12345-0@lo:400:kworker.0 Request processed in 36us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.318962:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919676.318976:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919676.318990:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978281472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.319136:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978280576:0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.319140:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978281472:12345-0@lo:400:kworker.0 Request processed in 151us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.319146:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919676.319160:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919676.319166:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978281600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.319168:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978280448:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.319178:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978280960:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.319190:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978281472:0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.319194:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978281600:12345-0@lo:400:kworker.0 Request processed in 29us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.319199:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1790919676.319221:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845a9f80 x1877914978281600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919676.319245:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978281600:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.319282:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919676.319289:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978281088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919676.319290:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919676.319309:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978281856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919676.319332:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978281088:12345-0@lo:400:kworker.0 Request processed in 42us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919676.319339:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790919676.319356:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919676.319368:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978281088:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.319395:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978280192 00000100:00100000:3.0:1790919676.319399:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978280192 00000100:00100000:3.0:1790919676.319444:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790919676.319451:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978280192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919676.319576:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281728 00000100:00100000:2.0:1790919676.319582:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281728 00000100:00100000:2.0:1790919676.319601:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281856 00000100:00100000:2.0:1790919676.319603:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281856 00000100:00100000:2.0:1790919676.319613:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919676.319618:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978281728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919676.319633:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919676.319671:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978281728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.319678:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919676.319693:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919676.319699:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978281856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919676.319709:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919676.319736:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978281856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.319743:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919676.319943:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978280192:12345-0@lo:400:kworker.0 Request processed in 492us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919676.319949:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790919676.320018:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978281856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919676.322872:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978281728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919676.322927:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978280192:0@lo:400:kworker.0 00000100:00100000:3.0:1790919676.323700:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978281216:0@lo:400:kworker.0 00000100:00100000:1.0:1790919676.324842:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978280704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919676.324995:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978280704:12345-0@lo:400:kworker.0 Request processed in 7026us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919676.325019:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919676.325585:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2871a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978280704:0@lo:400:kworker.0 00000001:00100000:0.0:1790919676.406842:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00000001:00100000:0.0:1790919676.406860:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000001:00100000:0.0:1790919676.428794:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00000001:00100000:0.0:1790919676.428810:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00010000:00010000:0.0:1790919676.572323:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919676.830758:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919676.830785:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978281984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919676.830859:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919676.839253:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978281984 00000100:00100000:2.0:1790919676.839268:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978281984 00000100:00100000:2.0:1790919676.839331:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919676.839342:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978281984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919676.839368:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919676.839459:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978281984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (8600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919676.839466:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919676.839525:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978281984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919677.341975:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978282112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919677.342045:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919677.342124:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282112 00000100:00100000:2.0:1790919677.342133:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282112 00000100:00100000:2.0:1790919677.342178:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919677.342187:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978282112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919677.342242:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790919677.342290:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978282112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919677.342296:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919677.342344:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978282112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919677.344123:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978282240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919677.344185:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919677.346817:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282240 00000100:00100000:3.0:1790919677.346890:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282240 00000100:00100000:3.0:1790919677.346957:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790919677.346967:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978282240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919677.347009:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919677.349392:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978282240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2421us (5200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919677.349529:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790919677.349641:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978282240:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790919677.599342:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919678.621947:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919678.716019:0:18998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1790919678.935620:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00010000:00010000:1.0:1790919679.649400:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919680.569887:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00010000:00010000:2.0:1790919680.669155:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919680.979305:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.979338:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.979356:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.979373:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.979403:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.979436:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919680.979552:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289024 00000100:00100000:0.0:1790919680.979562:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289024 00000100:00100000:0.0:1790919680.979621:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289152 00000100:00100000:0.0:1790919680.979624:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289152 00000100:00100000:0.0:1790919680.979637:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289664 00000100:00100000:0.0:1790919680.979639:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289664 00000100:00100000:0.0:1790919680.979655:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790919680.979663:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2413:x1877914958289024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919680.979733:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2413:x1877914958289024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919680.979747:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790919680.979765:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919680.979772:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958289152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919680.979810:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958289152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919680.979816:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919680.979828:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790919680.979833:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958289664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919680.979862:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958289664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919680.979869:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790919680.979888:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958288896 00000100:00100000:0.0:1790919680.979892:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958288896 00000100:00100000:0.0:1790919680.979916:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:0.0:1790919680.979923:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958288896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919680.979946:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958288896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919680.979952:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00080000:1.0:1790919680.980683:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919680.980688:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919680.982355:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289408 00000100:00100000:2.0:1790919680.982366:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289408 00000100:00100000:2.0:1790919680.982434:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289920 00000100:00100000:2.0:1790919680.982444:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289920 00000100:00100000:2.0:1790919680.982475:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790919680.982484:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958289408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1790919680.982523:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919680.982560:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958289408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (3184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919680.982568:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790919680.982585:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790919680.982592:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958289920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919680.982625:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958289920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919680.982631:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1790919680.984895:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.984941:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.984966:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919680.984991:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289280 00000100:00100000:1.0:1790919680.985000:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289280 00000100:00100000:1.0:1790919680.985049:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289792 00000100:00100000:1.0:1790919680.985077:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289792 00000100:00100000:1.0:1790919680.985102:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790919680.985111:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2413:x1877914958289280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919680.985181:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2413:x1877914958289280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919680.985202:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790919680.985219:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1790919680.985226:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b540191a-9155-42a4-9bf1-c88998854efa+5:2413:x1877914958289792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919680.985255:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b540191a-9155-42a4-9bf1-c88998854efa+5:2413:x1877914958289792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919680.985260:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00080000:1.0:1790919680.985395:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919680.985563:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958289536 00000100:00100000:1.0:1790919680.985568:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958289536 00000100:00100000:1.0:1790919680.985604:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1790919680.985611:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:2413:x1877914958289536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919680.985664:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:2413:x1877914958289536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 53us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919680.985671:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00080000:1.0:1790919680.985688:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919681.436228:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790919681.436242:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978282496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919681.436498:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978282752:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.443134:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919681.443211:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978282880:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.443259:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919681.443282:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978283392:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.443298:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919681.443310:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919681.443338:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978283008:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.443338:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978283904:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.443388:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919681.443394:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919681.443427:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978283520:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.443438:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978282624:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.443452:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919681.444108:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919681.447939:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282880 00000100:00100000:1.0:1790919681.447953:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282880 00000100:00100000:1.0:1790919681.448152:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283392 00000100:00100000:1.0:1790919681.448156:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283392 00000100:00100000:1.0:1790919681.448172:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283008 00000100:00100000:1.0:1790919681.448175:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283008 00000100:00100000:1.0:1790919681.448186:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283520 00000100:00100000:1.0:1790919681.448189:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283520 00000100:00100000:1.0:1790919681.448205:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790919681.448214:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978282880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919681.448303:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978282880:12345-0@lo:400:kworker.0 Request processed in 89us (5043us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919681.448323:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790919681.448341:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790919681.448346:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978283392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919681.448387:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978283392:12345-0@lo:400:kworker.0 Request processed in 41us (5078us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919681.448393:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790919681.448404:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919681.448410:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978283008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919681.448439:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978283008:12345-0@lo:400:kworker.0 Request processed in 29us (5048us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919681.448444:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919681.448455:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790919681.448460:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978283520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919681.448487:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978283520:12345-0@lo:400:kworker.0 Request processed in 26us (5035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919681.448493:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790919681.448527:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919681.448531:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919681.459500:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919681.459557:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282752 00000100:00100000:0.0:1790919681.459565:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282752 00000100:00100000:0.0:1790919681.459930:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919681.459942:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978282752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.460951:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978282752:12345-0@lo:400:kworker.0 Request processed in 1011us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.460960:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790919681.461097:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978282752:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.461109:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978283264:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.461144:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919681.461172:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283264 00000100:00100000:0.0:1790919681.461178:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283264 00000100:00100000:0.0:1790919681.461202:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919681.461208:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978283264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.461235:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978283264:12345-0@lo:400:kworker.0 Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.461241:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919681.461262:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978283264:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.461270:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978283776:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.461294:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919681.461340:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978284288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919681.461363:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919681.461427:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283904 00000100:00100000:0.0:1790919681.461431:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283904 00000100:00100000:0.0:1790919681.461466:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283776 00000100:00100000:0.0:1790919681.461469:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283776 00000100:00100000:0.0:1790919681.461485:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919681.461491:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978283904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.461524:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978283904:12345-0@lo:400:kworker.0 Request processed in 32us (18135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.461538:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919681.461550:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790919681.461556:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978283776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.462384:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282624 00000100:00100000:2.0:1790919681.462393:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282624 00000100:00100000:2.0:1790919681.462436:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790919681.462444:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3461:x1877914978282624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.462500:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3461:x1877914978282624:12345-0@lo:400:kworker.0 Request processed in 57us (18393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919681.462508:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790919681.462560:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978282880:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.462564:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978283776:12345-0@lo:400:kworker.0 Request processed in 1005us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.462574:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919681.462577:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978283392:0@lo:400:kworker.0 00010000:00080000:2.0:1790919681.462593:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f38d549180 x1877914978283904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919681.462605:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978283904:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.462610:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282368 00000100:00100000:0.0:1790919681.462623:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282368 00000100:00100000:0.0:1790919681.462650:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978282496 00000100:00100000:0.0:1790919681.462654:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978282496 00000100:00100000:2.0:1790919681.462659:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978282624:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.462669:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978284288 00000100:00100000:2.0:1790919681.462670:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978283136:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.462675:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978284288 00000100:00100000:2.0:1790919681.462701:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919681.462705:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919681.462714:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978282368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919681.462724:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283136 00000100:00100000:2.0:1790919681.462728:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283136 00002000:00000024:0.0:1790919681.462745:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1790919681.462756:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919681.462765:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978283136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.464362:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978283520:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.464389:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978284032:0@lo:400:kworker.0 00000100:00080000:1.0:1790919681.467734:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790919681.467742:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919681.469655:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978283136:12345-0@lo:400:kworker.0 Request processed in 6883us (6947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919681.469668:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919681.469751:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919681.469805:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978283136:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.469816:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978283648:0@lo:400:kworker.0 00000100:00100000:2.0:1790919681.469863:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919681.469912:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978283648 00000100:00100000:2.0:1790919681.469919:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978283648 00000100:00100000:2.0:1790919681.469956:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919681.469964:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978283648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.470108:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919681.470157:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978283008:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.470195:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978284032 00000100:00100000:3.0:1790919681.470199:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978284032 00000100:00100000:3.0:1790919681.470231:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790919681.470238:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978284032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.470293:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978284032:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919681.470300:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1790919681.470316:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919681.470326:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978284160:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.470349:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919681.470366:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978284160 00000100:00100000:3.0:1790919681.470369:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978284160 00000100:00100000:3.0:1790919681.470401:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790919681.470406:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978284160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.470431:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978284160:12345-0@lo:400:kworker.0 Request processed in 25us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919681.470436:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1790919681.470447:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790919681.470461:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b5eed500 x1877914978284160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919681.470471:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978284160:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.470507:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978284032:0@lo:400:kworker.0 00000100:00100000:0.0:1790919681.470789:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978282368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8074us (27657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.470799:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919681.470818:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919681.470828:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978282496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919681.470844:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1790919681.470891:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978282496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (27595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.470898:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919681.470910:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919681.470919:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978284288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919681.470950:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919681.470983:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978284288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (9619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919681.470989:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919681.471042:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978284288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919681.471076:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978283776:0@lo:400:kworker.0 00000100:00100000:3.0:1790919681.471228:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978282496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919681.471669:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978283648:12345-0@lo:400:kworker.0 Request processed in 1704us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919681.471677:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919681.471708:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978283648:0@lo:400:kworker.0 00010000:00010000:0.0:1790919681.695792:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919681.949589:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978284416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919681.949661:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919681.949733:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978284416 00000100:00100000:2.0:1790919681.949748:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978284416 00000100:00100000:2.0:1790919681.950392:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919681.950405:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978284416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919681.950430:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919681.950498:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978284416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919681.950507:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790919681.951791:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978284416:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790919682.012759:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1790919682.038468:0:19146:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe75dad770 20000000:00000080:2.0:1790919682.038486:0:19146:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f3ac6fa400 uarg=0000000000000000 20000000:01000000:2.0:1790919682.038526:0:19146:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919682.038532:0:19146:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919682.038537:0:19146:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790919682.039596:0:19147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790919682.039737:0:19146:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790919682.046207:0:19146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790919682.046237:0:19146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046257:0:19146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159148b9 expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046283:0:19146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159148c7 expref: 23 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046291:0:19146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914906 expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046298:0:19146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046307:0:19146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046314:0:19146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046322:0:19146:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046363:0:19146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046391:0:19146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 12 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.046406:0:19146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284544:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919682.046513:0:19146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046522:0:19146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.046539:0:19146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284672:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919682.046576:0:19146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046584:0:19146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.046593:0:19146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284800:0@lo:104: 00000100:00100000:2.0:1790919682.046630:0:19146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919682.046673:0:19146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914906 expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046681:0:19146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914906 expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.046689:0:19146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284928:0@lo:104: 00000100:00100000:3.0:1790919682.046700:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978284800 00000100:00100000:3.0:1790919682.046709:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978284800 00000100:00100000:2.0:1790919682.046714:0:19146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919682.046747:0:19146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159148c7 expref: 23 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046756:0:19146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159148c7 expref: 23 pid: 16400 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919682.046763:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978284928 00000100:00100000:2.0:1790919682.046765:0:19146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978285056:0@lo:104: 00000100:00100000:3.0:1790919682.046769:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978284928 00000100:00100000:3.0:1790919682.046792:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919682.046793:0:19146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919682.046806:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:19146:x1877914978284800:12345-0@lo:104: 00010000:00010000:2.0:1790919682.046816:0:19146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159148b9 expref: 23 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.046836:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.046842:0:19146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159148b9 expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.046857:0:19146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978285184:0@lo:104: 00000100:00100000:2.0:1790919682.046883:0:19146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919682.046898:0:19146:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c840 going to sleep for 11 seconds 00010000:00010000:3.0:1790919682.046917:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919682.046921:0:19146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284800:0@lo:104: 00000100:00100000:3.0:1790919682.046928:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:19146:x1877914978284800:12345-0@lo:104: Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.046937:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790919682.046954:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285056 00000100:00100000:3.0:1790919682.046957:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285056 00000100:00100000:3.0:1790919682.046968:0:16390:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285184 00000100:00100000:3.0:1790919682.046983:0:16390:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285184 00000100:00100000:3.0:1790919682.046998:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919682.047003:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+5:19146:x1877914978284928:12345-0@lo:104: 00010000:00010000:3.0:1790919682.047012:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.047084:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790919682.047090:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+5:19146:x1877914978284928:12345-0@lo:104: Request processed in 87us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.047097:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919682.047109:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919682.047116:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:19146:x1877914978285056:12345-0@lo:104: 00010000:00010000:3.0:1790919682.047124:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.047157:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790919682.047162:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+4:19146:x1877914978285056:12345-0@lo:104: Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.047178:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919682.047191:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919682.047197:0:16390:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:19146:x1877914978285184:12345-0@lo:104: 00010000:00010000:3.0:1790919682.047206:0:16390:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.047237:0:16390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790919682.047242:0:16390:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+3:19146:x1877914978285184:12345-0@lo:104: Request processed in 46us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.047248:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790919682.047264:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790919682.047271:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.047277:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:3.0:1790919682.047281:0:18447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.047289:0:18447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919682.047296:0:18447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919682.047302:0:18447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919682.047328:0:18447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.047334:0:18447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919682.047803:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790919682.047810:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047819:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919682.047822:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047828:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919682.047835:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919682.047840:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919682.047858:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047880:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919682.047890:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047896:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1cc00/0x951c50ad15914906 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591490d expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047911:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919682.047914:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047920:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919682.047923:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047930:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919682.047936:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919682.047941:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919682.047955:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047960:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919682.047987:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.047994:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015600/0x951c50ad159148c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148ce expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048010:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919682.048013:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048018:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1dc00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919682.048021:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048028:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919682.048034:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919682.048039:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919682.048067:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048074:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919682.048082:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048088:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad159148b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159148c0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048099:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919682.048101:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919682.048103:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919682.048111:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919682.048140:0:19146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284928:0@lo:104: 00000100:00100000:0.0:1790919682.048141:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978285568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919682.048155:0:19146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978285056:0@lo:104: 00000100:00100000:2.0:1790919682.048164:0:19146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978285184:0@lo:104: 00000100:00100000:0.0:1790919682.048190:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919682.048228:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919682.048234:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978285696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919682.048258:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919682.048259:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285568 00000100:00100000:2.0:1790919682.048266:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285568 00010000:00010000:2.0:1790919682.048304:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159148c7 expref: 24 pid: 16400 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.048328:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285696 00000100:00100000:2.0:1790919682.048331:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285696 00010000:00010000:2.0:1790919682.048343:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159148b9 expref: 25 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919682.048357:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919682.048367:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+25:3458:x1877914978285568:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919682.048546:0:16393:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919682.048554:0:16393:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790919682.048570:0:16392:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919682.048578:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919682.048586:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+25:3458:x1877914978285696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919682.048599:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919682.048605:0:16392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159148b9 expref: 25 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048615:0:16392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159148b9 expref: 25 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048629:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee000/0x951c50ad159148c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159148b9 expref: 25 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919682.048646:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919682.048680:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790919682.048683:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3458:x1877914978285696:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (424us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919682.048688:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159148c7 expref: 24 pid: 16400 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919682.048696:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790919682.048702:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159148c7 expref: 24 pid: 16400 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.048724:0:16391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1ca00/0x951c50ad159148ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159148c7 expref: 23 pid: 16400 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.048734:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919682.048760:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3458:x1877914978285568:12345-0@lo:103:ldlm_bl.0 Request processed in 394us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919682.048767:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919682.049631:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978285696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919682.049643:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978285568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919682.050186:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050198:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad15914a5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914a64 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050227:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919682.050241:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919682.050243:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919682.050261:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978285312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919682.050310:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919682.050341:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919682.050347:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978285440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919682.050380:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919682.050414:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285312 00000100:00100000:3.0:1790919682.050420:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285312 00010000:00010000:3.0:1790919682.050455:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914a5d expref: 22 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919682.050477:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285440 00000100:00100000:3.0:1790919682.050481:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285440 00010000:00010000:3.0:1790919682.050493:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914906 expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919682.050512:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919682.050519:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:3460:x1877914978285312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919682.050531:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919682.050535:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050561:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050575:0:16391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ef600/0x951c50ad15914a64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914a5d expref: 23 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050586:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919682.050620:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3460:x1877914978285312:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.050626:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919682.050643:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919682.050650:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3460:x1877914978285440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919682.050674:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919682.050681:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914906 expref: 21 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050690:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914906 expref: 21 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050701:0:16391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee400/0x951c50ad1591490d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914906 expref: 21 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.050710:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919682.050734:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:3460:x1877914978285440:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.050739:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919682.051655:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978285440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919682.051666:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978285312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919682.054122:0:19146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284544:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919682.054483:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919682.054522:0:19146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19146:1877914978284672:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919682.054567:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919682.054632:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290048 00000100:00100000:0.0:1790919682.054632:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290176 00000100:00100000:3.0:1790919682.054640:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290048 00000100:00100000:0.0:1790919682.054647:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290176 00010000:00010000:2.0:1790919682.054684:0:19146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.054688:0:16391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 14 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919682.054735:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790919682.054745:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeb26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24ec2864-d240-484b-9820-6394233cc11c+14:2414:x1877914958290048:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919682.054760:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919682.054766:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 14 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.054777:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 14 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.054794:0:16391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697e00/0x951c50ad15914bfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39053 expref: 14 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.054808:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919682.054873:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeb26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958290048:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.054881:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00010000:00010000:0.0:1790919682.058296:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919682.058479:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1790919682.058494:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24ec2864-d240-484b-9820-6394233cc11c+12:2413:x1877914958290176:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919682.058509:0:16391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919682.058516:0:16391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058529:0:16391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058563:0:16391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014200/0x951c50ad15914bbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fe3 expref: 12 pid: 16401 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058578:0:16391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058587:0:16391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058604:0:16391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058611:0:16391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058618:0:16391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058624:0:16391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058631:0:16391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919682.058635:0:16391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058642:0:16391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058662:0:16391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919682.058683:0:16391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919682.058699:0:19146:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.058711:0:19146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919682.058718:0:19146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697200/0x951c50ad15914c2b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919682.058744:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24ec2864-d240-484b-9820-6394233cc11c+11:2413:x1877914958290176:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 254us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919682.058752:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1790919682.461627:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919682.461652:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978285824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919682.461720:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919682.462213:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285824 00000100:00100000:2.0:1790919682.462222:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285824 00000100:00100000:2.0:1790919682.462266:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790919682.462354:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978285824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919682.462410:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790919682.462476:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978285824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919682.462495:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790919682.462924:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978285824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919682.463553:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919682.464685:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978285952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919682.464750:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919682.465248:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978285952 00000100:00100000:2.0:1790919682.465257:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978285952 00000100:00100000:2.0:1790919682.465392:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919682.465402:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978285952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919682.465442:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919682.465501:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978285952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919682.465508:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790919682.465659:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978285952:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790919682.716420:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919683.473800:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919683.473932:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290304 00000100:00100000:2.0:1790919683.473942:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290304 00000100:00100000:2.0:1790919683.473996:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:2.0:1790919683.474006:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+11:15029:x1877914958290304:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919683.474023:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919683.474042:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381697a00/0x951c50ad15914c32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3908b expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.474097:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697a00/0x951c50ad15914c32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3908b expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.474110:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381697a00/0x951c50ad15914c32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3908b expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.474119:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697a00, rc 0) 00000100:00100000:2.0:1790919683.474173:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+12:15029:x1877914958290304:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 168us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.474180:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:0.0:1790919683.481449:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919683.481488:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290432 00000100:00100000:2.0:1790919683.481499:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290432 00000100:00100000:2.0:1790919683.481559:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:2.0:1790919683.481571:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+12:15029:x1877914958290432:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.481938:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+12:15029:x1877914958290432:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 369us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.481946:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:3.0:1790919683.490293:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919683.490329:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290560 00000100:00100000:3.0:1790919683.490339:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290560 00000100:00100000:3.0:1790919683.490397:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:3.0:1790919683.490406:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+12:15029:x1877914958290560:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919683.490615:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+12:15029:x1877914958290560:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 209us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919683.490623:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:1.0:1790919683.496526:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919683.497075:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290688 00000100:00100000:2.0:1790919683.497085:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290688 00000100:00100000:3.0:1790919683.497181:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:3.0:1790919683.497193:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+12:15029:x1877914958290688:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919683.497210:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919683.497227:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2cc00/0x951c50ad15914c39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39092 expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919683.497393:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2cc00/0x951c50ad15914c39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39092 expref: 13 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919683.497417:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2cc00/0x951c50ad15914c39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39092 expref: 13 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919683.497427:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2cc00, rc 0) 00000100:00100000:3.0:1790919683.497520:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:15029:x1877914958290688:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 329us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919683.497527:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:3.0:1790919683.499400:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919683.499488:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290816 00000100:00100000:1.0:1790919683.499496:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290816 00000100:00100000:1.0:1790919683.499535:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:1.0:1790919683.499542:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15029:x1877914958290816:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919683.500127:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:15029:x1877914958290816:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 583us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919683.500136:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:2.0:1790919683.514178:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919683.514212:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958290944 00000100:00100000:2.0:1790919683.514219:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958290944 00000100:00100000:2.0:1790919683.514261:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:2.0:1790919683.514270:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:15029:x1877914958290944:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.514624:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:15029:x1877914958290944:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 354us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.514633:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 10000000:01000000:2.0:1790919683.548232:0:16403:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919683.548240:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3bd7e8000 from 13 10000000:01000000:2.0:1790919683.548246:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919683.548292:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.548304:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.548316:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919683.548386:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.548457:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919683.548562:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919683.549501:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286080 00000100:00100000:1.0:1790919683.549511:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286080 00000100:00100000:1.0:1790919683.549562:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790919683.549581:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:16403:x1877914978286080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919683.549597:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919683.549740:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1c400/0x951c50ad15914c47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914c40 expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.549770:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1c400/0x951c50ad15914c47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914c40 expref: 21 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.549782:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1c400/0x951c50ad15914c47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914c40 expref: 21 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.549791:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c400, rc 0) 00000100:00100000:1.0:1790919683.550182:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978286080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 612us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919683.550191:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790919683.550249:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919683.550265:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.550272:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919683.550323:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.550352:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.550404:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3851c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919683.550472:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286208 00000100:00100000:1.0:1790919683.550477:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286208 00000100:00100000:1.0:1790919683.550501:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790919683.550507:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978286208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919683.551201:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978286208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 691us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919683.551211:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790919683.551563:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.551606:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.551651:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919683.551687:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:3.0:1790919683.551778:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286336 00000100:00100000:3.0:1790919683.551785:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286336 00000100:00100000:3.0:1790919683.551821:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790919683.551829:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978286336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919683.551999:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978286336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919683.552008:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790919683.552269:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790919683.556186:0:19225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790919683.556743:0:16403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790919683.556766:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919683.556778:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.556802:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919683.556812:0:16403:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919683.556815:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f385574800 from 13 10000000:01000000:0.0:1790919683.556818:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919683.556852:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.556859:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.556869:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919683.556894:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.556961:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.557012:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3851c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.557218:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286464 00000100:00100000:2.0:1790919683.557231:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286464 00000100:00100000:2.0:1790919683.557278:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790919683.557288:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:16403:x1877914978286464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919683.557302:0:16401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919683.557314:0:16401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381696200/0x951c50ad15914c55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914c4e expref: -99 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.557338:0:16401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381696200/0x951c50ad15914c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914c4e expref: 22 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.557347:0:16401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381696200/0x951c50ad15914c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914c4e expref: 22 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.557355:0:16401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696200, rc 0) 00000100:00100000:2.0:1790919683.557411:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978286464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.557418:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790919683.557611:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919683.557625:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.557633:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919683.557691:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.557720:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.557757:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3851c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.557850:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286592 00000100:00100000:2.0:1790919683.557854:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286592 00000100:00100000:2.0:1790919683.557881:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790919683.557888:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978286592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.558246:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978286592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.558253:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790919683.558335:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.558375:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.558415:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.558440:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3851c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.558751:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286720 00000100:00100000:2.0:1790919683.558757:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286720 00000100:00100000:2.0:1790919683.558780:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790919683.558786:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978286720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.558935:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978286720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.558947:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790919683.558972:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790919683.560022:0:19226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790919683.561775:0:16403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790919683.561806:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919683.561817:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.561830:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919683.561840:0:16403:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919683.561843:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f391982800 from 13 10000000:01000000:0.0:1790919683.561846:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919683.561890:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.561899:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.561909:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919683.561932:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.561999:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.562074:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.562418:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286848 00000100:00100000:2.0:1790919683.562426:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286848 00000100:00100000:2.0:1790919683.562471:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790919683.562481:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:16403:x1877914978286848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919683.562494:0:16398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919683.562511:0:16398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381696800/0x951c50ad15914c63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914c5c expref: -99 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.562534:0:16398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381696800/0x951c50ad15914c63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914c5c expref: 23 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.562544:0:16398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381696800/0x951c50ad15914c63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914c5c expref: 23 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.562564:0:16398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696800, rc 0) 00000100:00100000:2.0:1790919683.562614:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38322d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978286848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.562620:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790919683.562848:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919683.562871:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.562881:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919683.562932:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.562963:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.562996:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.563133:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978286976 00000100:00100000:2.0:1790919683.563138:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978286976 00000100:00100000:2.0:1790919683.563169:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790919683.563176:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978286976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.563436:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978286976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.563444:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790919683.563859:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978286976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919683.563896:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919683.563937:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919683.563971:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d5f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919683.564017:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978287104 00000100:00100000:0.0:1790919683.564022:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978287104 00000100:00100000:0.0:1790919683.564079:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790919683.564086:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978287104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.564241:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978287104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919683.564249:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790919683.564307:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790919683.567525:0:19227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790919683.567648:0:16403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790919683.567672:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919683.567684:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.567696:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919683.567706:0:16403:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790919683.567708:0:16403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3aee80800 from 13 10000000:01000000:1.0:1790919683.567711:0:16403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790919683.567749:0:16403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.567757:0:16403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.567768:0:16403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919683.567792:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398dab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919683.567856:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919683.567918:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d5f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.568039:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978287232 00000100:00100000:2.0:1790919683.568046:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978287232 00000100:00100000:2.0:1790919683.568108:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790919683.568117:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:16403:x1877914978287232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919683.568130:0:16400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919683.568142:0:16400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f381697c00/0x951c50ad15914c71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914c6a expref: -99 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.568493:0:16400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f381697c00/0x951c50ad15914c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914c6a expref: 24 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.568506:0:16400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f381697c00/0x951c50ad15914c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914c6a expref: 24 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919683.568516:0:16400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697c00, rc 0) 00000100:00100000:2.0:1790919683.568585:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978287232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 469us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.568593:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790919683.568978:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398dab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919683.569000:0:16403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.569010:0:16403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919683.569216:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.569257:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.569293:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.569481:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978287360 00000100:00100000:2.0:1790919683.569488:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978287360 00000100:00100000:2.0:1790919683.569529:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790919683.569538:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978287360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.569861:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978287360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.569870:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790919683.569935:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.569964:0:16403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919683.570004:0:16403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919683.570023:0:16403:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919683.570430:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978287488 00000100:00100000:2.0:1790919683.570436:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978287488 00000100:00100000:2.0:1790919683.570471:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790919683.570479:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978287488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919683.570642:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:16403:x1877914978287488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919683.570649:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790919683.570813:0:16403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb00aa6a-67be-455f-87d9-71f2084f0f0a:16403:1877914978287488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790919683.573542:0:19229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790919683.573847:0:16403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790919683.573867:0:16403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919683.573879:0:16403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919683.573892:0:16403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919683.741113:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919684.253706:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790919684.764279:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919684.878561:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919684.878628:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291072 00000100:00100000:3.0:1790919684.878639:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291072 00000100:00100000:3.0:1790919684.878715:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:3.0:1790919684.878725:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:15698:x1877914958291072:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919684.878765:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919684.878789:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39099 expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.878852:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.878866:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.878879:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.878893:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.878900:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.878905:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879244:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad15914c8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879254:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad15914c8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879261:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad15914c8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919684.879286:0:18910:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790919684.879295:0:18910:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919684.879333:0:18910:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad15914c8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879344:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879362:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879369:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879376:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919684.879380:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879387:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879409:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:3.0:1790919684.879412:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919684.879417:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879424:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914c7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879437:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879444:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879460:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879466:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919684.879469:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879475:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879483:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95f3a2027d00) 00010000:00010000:3.0:1790919684.879486:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919684.879488:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879494:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914c86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879526:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39099 expref: 8 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879539:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad15914c8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39099 expref: 7 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.879547:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3a2027600) 00010000:00010000:3.0:1790919684.879549:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919684.879552:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c000, rc 0) 00000100:00100000:3.0:1790919684.879623:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15698:x1877914958291072:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 899us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919684.879641:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00080000:0.0:1790919684.880480:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919684.885741:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919684.885835:0:16417:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291200 00000100:00100000:0.0:1790919684.885845:0:16417:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291200 00000100:00100000:0.0:1790919684.885899:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790919684.885911:0:16417:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15698:x1877914958291200:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790919684.885995:0:16417:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15698:x1877914958291200:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919684.886003:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790919684.888393:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919684.888480:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291456 00000100:00100000:0.0:1790919684.888488:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291456 00000100:00100000:0.0:1790919684.888541:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1790919684.888550:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15698:x1877914958291456:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919684.888569:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919684.888590:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914c94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390a0 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.888657:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.888688:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.888699:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.888865:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.888874:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.888881:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889330:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914ca9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889340:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889357:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919684.889368:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790919684.889551:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889560:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889566:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889579:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919684.889584:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889591:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889602:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3a2027600) 00010000:00010000:0.0:1790919684.889605:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919684.889610:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889616:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914c9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889628:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889634:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889640:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889644:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919684.889647:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889652:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.889669:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95f382b81000) 00010000:00010000:0.0:1790919684.889671:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919684.889674:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.891019:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914ca2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.891624:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914c94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390a0 expref: 10 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.891641:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390a0 expref: 9 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.891650:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f382b81800) 00010000:00010000:0.0:1790919684.891653:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919684.891655:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380031a00, rc 0) 00000100:00100000:0.0:1790919684.891736:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15698:x1877914958291456:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3185us (3349us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790919684.891744:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1790919684.895442:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919684.895522:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291584 00000100:00100000:3.0:1790919684.895531:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291584 00000100:00100000:3.0:1790919684.895586:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790919684.895596:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15698:x1877914958291584:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790919684.895697:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15698:x1877914958291584:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919684.895705:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1790919684.901520:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919684.901611:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291712 00000100:00100000:2.0:1790919684.901621:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291712 00000100:00100000:2.0:1790919684.901741:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1790919684.901752:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15698:x1877914958291712:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1790919684.903946:0:16405:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2151us 00000100:00080000:0.0:1790919684.904290:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919684.912896:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15698:x1877914958291712:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 11140us (11379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919684.912910:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1790919684.951686:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919684.954962:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291840 00000100:00100000:3.0:1790919684.954977:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291840 00000100:00100000:3.0:1790919684.955044:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790919684.955067:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15704:x1877914958291840:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919684.955148:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919684.955170:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914cb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390a7 expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955304:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955321:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955332:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955365:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955387:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955395:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955646:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955654:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955660:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955666:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919684.955670:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955676:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955687:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:3.0:1790919684.955689:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919684.955693:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955699:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955709:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955722:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955727:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955731:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919684.955734:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955740:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955747:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95f3a2027d00) 00010000:00010000:3.0:1790919684.955750:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919684.955752:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955758:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914cc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955790:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914cb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390a7 expref: 10 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.955799:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:3.0:1790919684.955801:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919684.955805:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914cb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390a7 expref: 10 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919684.956365:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2d800, rc 0) 00000100:00100000:2.0:1790919684.958933:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15704:x1877914958291840:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 3869us (7244us total) trans 0 rc 301/301 00000100:00100000:2.0:1790919684.958946:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790919684.965429:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919684.965539:0:16415:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958291968 00000100:00100000:2.0:1790919684.965549:0:16415:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958291968 00000100:00100000:2.0:1790919684.965609:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790919684.965619:0:16415:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15704:x1877914958291968:12345-192.168.203.11@tcp:700:lfs.0 00000100:00100000:2.0:1790919684.965705:0:16415:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15704:x1877914958291968:12345-192.168.203.11@tcp:700:lfs.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919684.965712:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1790919684.967976:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919684.968097:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958292224 00000100:00100000:1.0:1790919684.968105:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958292224 00000100:00100000:1.0:1790919684.968163:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790919684.968184:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:15704:x1877914958292224:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:1.0:1790919684.968416:0:16408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919684.968443:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914be5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39014 expref: 9 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.968463:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:1.0:1790919684.968469:0:16408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790919684.968686:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.968705:0:16408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 5 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.968713:0:16408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.968744:0:16408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 5 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.968759:0:16408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 5 pid: 16408 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919684.968773:0:16408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16408:1877914978287616:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919684.968895:0:16408:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398d5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919684.977112:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919684.977194:0:16408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f398da9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:16408:1877914978287616:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919684.977220:0:16408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919684.978110:0:19148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958292352 00000100:00100000:2.0:1790919684.978120:0:19148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958292352 00010000:00010000:2.0:1790919684.978251:0:19148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 6 pid: 16408 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919684.978296:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1790919684.978307:0:19148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:2414:x1877914958292352:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919684.978323:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919684.978331:0:19148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 6 pid: 16408 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919684.978344:0:19148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 6 pid: 16408 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919684.978377:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c000/0x951c50ad15914c24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39084 expref: 6 pid: 16408 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919684.978396:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:2.0:1790919684.978401:0:19148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919684.978429:0:19148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919684.978437:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919684.978467:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919684.978530:0:19148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958292352:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 225us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919684.978539:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:1.0:1790919684.978970:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790919684.978988:0:16408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.979011:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.979036:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.979048:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.979077:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.980822:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.981189:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919684.981201:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919684.982162:0:16408:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045a173e7 reply state 0000000082fef59c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982181:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982190:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:1.0:1790919684.982192:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919684.982196:0:16408:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790919684.982203:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790919684.982211:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982234:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982240:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982246:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919684.982251:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982259:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982270:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142200) 00010000:00010000:1.0:1790919684.982273:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919684.982276:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982335:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914ccc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919684.982380:0:16408:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045a173e7 reply state 0000000082fef59c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982457:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919684.982463:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95f382b81000) 00010000:00010000:1.0:1790919684.982466:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919684.982468:0:16408:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790919684.982568:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+10:15704:x1877914958292224:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 14384us (14587us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790919684.982582:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790919685.049592:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.049750:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958292480 00000100:00100000:2.0:1790919685.049763:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958292480 00000100:00100000:2.0:1790919685.049893:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1790919685.049905:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+10:15712:x1877914958292480:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:2.0:1790919685.049930:0:16407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.049953:0:16407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15914ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390ae expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.050025:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914ce8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.050038:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.050048:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.050217:0:16407:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919685.050221:0:16407:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919685.050388:0:16407:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.050415:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15914ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ae expref: 12 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.050434:0:16407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ae expref: 11 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.050442:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919685.050445:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790919685.050448:0:16407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697e00, rc 0) 00000100:00100000:2.0:1790919685.050677:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+11:15712:x1877914958292480:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 773us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.050685:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1790919685.072247:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919685.072363:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958292608 00000100:00100000:1.0:1790919685.072374:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958292608 00000100:00100000:1.0:1790919685.072644:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790919685.072655:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+5:15713:x1877914958292608:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919685.072677:0:16405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919685.072698:0:16405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914cef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390b5 expref: -99 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.072776:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914cf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.072791:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.072803:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919685.072838:0:16405:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919685.072842:0:16405:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919685.072862:0:16405:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.072886:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914cef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390b5 expref: 7 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.072903:0:16405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390b5 expref: 6 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.072944:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919685.072947:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919685.072951:0:16405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d400, rc 0) 00000100:00100000:1.0:1790919685.073015:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+6:15713:x1877914958292608:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 362us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919685.073023:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1790919685.075882:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919685.076003:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958292736 00000100:00100000:3.0:1790919685.076012:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958292736 00000100:00100000:3.0:1790919685.076065:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790919685.076073:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:15713:x1877914958292736:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919685.076088:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919685.076103:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad15914cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390bc expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.076162:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.076172:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.076180:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.076187:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.076193:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.076198:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.078197:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.078217:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.078229:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919685.078269:0:18910:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919685.078273:0:18910:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919685.078313:0:18910:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.079547:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.079556:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.079565:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.079572:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919685.079577:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080221:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080240:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:0.0:1790919685.080243:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919685.080249:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080257:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2d800/0x951c50ad15914d04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080273:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080280:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080322:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.080329:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919685.081239:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.081254:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.081266:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95f382b81000) 00010000:00010000:0.0:1790919685.081269:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919685.081273:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.081280:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c600/0x951c50ad15914d0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.082543:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2dc00/0x951c50ad15914cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390bc expref: 8 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.082570:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390bc expref: 7 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.083264:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:0.0:1790919685.083270:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919685.083274:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030c00, rc 0) 00000100:00100000:0.0:1790919685.083754:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+7:15713:x1877914958292736:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 7674us (7874us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.083788:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000040:00080000:1.0:1790919685.090300:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790919685.093121:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.093183:0:16417:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958292864 00000100:00100000:0.0:1790919685.093193:0:16417:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958292864 00000100:00080000:1.0:1790919685.093337:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919685.094422:0:16417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1790919685.094439:0:16417:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b540191a-9155-42a4-9bf1-c88998854efa+5:15713:x1877914958292864:12345-192.168.203.11@tcp:900:lfs.0 00000100:00100000:0.0:1790919685.094534:0:16417:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b540191a-9155-42a4-9bf1-c88998854efa+5:15713:x1877914958292864:12345-192.168.203.11@tcp:900:lfs.0 Request processed in 101us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.094543:0:16417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1790919685.101133:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919685.101379:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958293120 00000100:00100000:1.0:1790919685.101389:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958293120 00000100:00100000:1.0:1790919685.101445:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1790919685.101453:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+7:15713:x1877914958293120:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919685.101474:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919685.101494:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390c3 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919685.101580:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790919685.101702:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914d19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390c3 expref: 9 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.101718:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919685.101721:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919685.101727:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad15914d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390c3 expref: 9 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.101742:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d600, rc 0) 00000100:00100000:1.0:1790919685.101826:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+8:15713:x1877914958293120:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 369us (698us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1790919685.101833:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1790919685.103794:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.103909:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958293376 00000100:00100000:2.0:1790919685.103918:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958293376 00000100:00100000:2.0:1790919685.103975:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1790919685.103985:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b540191a-9155-42a4-9bf1-c88998854efa+8:15713:x1877914958293376:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:2.0:1790919685.104044:0:16407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919685.104096:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390bc expref: 8 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.104115:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:2.0:1790919685.104120:0:16407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919685.104164:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.104178:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.104188:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919685.104374:0:16407:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f69526b7 reply state 00000000a435f4c1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.104386:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.104392:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:2.0:1790919685.104395:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790919685.104397:0:16407:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790919685.104404:0:16407:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790919685.104472:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b540191a-9155-42a4-9bf1-c88998854efa+9:15713:x1877914958293376:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 488us (685us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790919685.104479:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790919685.107611:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.107742:0:16409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958293632 00000100:00100000:0.0:1790919685.107751:0:16409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958293632 00000100:00100000:0.0:1790919685.107810:0:16409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790919685.107820:0:16409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b540191a-9155-42a4-9bf1-c88998854efa+9:15713:x1877914958293632:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790919685.108688:0:16409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b540191a-9155-42a4-9bf1-c88998854efa+10:15713:x1877914958293632:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 865us (1081us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790919685.108698:0:16409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1790919685.116924:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.117018:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958293888 00000100:00100000:2.0:1790919685.117029:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958293888 00000100:00100000:2.0:1790919685.117103:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1790919685.117114:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+10:15713:x1877914958293888:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919685.117139:0:16405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.117170:0:16405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15914d2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390ca expref: -99 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.117263:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.117283:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.117294:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.117307:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.117314:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.117320:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.117444:0:16405:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919685.117534:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118523:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118535:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118541:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919685.118667:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118676:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118707:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919685.118710:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919685.118714:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118720:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118736:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118743:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118817:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118823:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919685.118826:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118832:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118841:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95f382b81000) 00010000:00010000:2.0:1790919685.118843:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919685.118846:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118852:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118937:0:16405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15914d2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ca expref: 12 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118950:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919685.118952:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919685.118956:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15914d2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ca expref: 12 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.118965:0:16405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381697200, rc 0) 00000100:00100000:2.0:1790919685.119026:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+11:15713:x1877914958293888:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1914us (2117us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790919685.119250:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:3.0:1790919685.124358:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.124691:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958294016 00000100:00100000:0.0:1790919685.124701:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958294016 00000100:00100000:0.0:1790919685.124855:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1790919685.124866:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+11:15713:x1877914958294016:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1790919685.124888:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919685.124907:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390d1 expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.124981:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.125011:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.125022:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919685.125266:0:18910:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919685.125271:0:18910:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919685.125293:0:18910:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.125319:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 13 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.125337:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 12 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.125345:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:0.0:1790919685.125359:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919685.125363:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030c00, rc 0) 00000100:00100000:0.0:1790919685.125427:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+12:15713:x1877914958294016:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 562us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.125434:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1790919685.130766:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.130886:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958294144 00000100:00100000:2.0:1790919685.130901:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958294144 00000100:00100000:2.0:1790919685.130955:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790919685.130965:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b540191a-9155-42a4-9bf1-c88998854efa+12:15713:x1877914958294144:12345-192.168.203.11@tcp:37:lfs.0 00000100:00100000:2.0:1790919685.138706:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b540191a-9155-42a4-9bf1-c88998854efa+12:15713:x1877914958294144:12345-192.168.203.11@tcp:37:lfs.0 Request processed in 7731us (7937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.138720:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1790919685.144092:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.144126:0:16409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958294400 00000100:00100000:0.0:1790919685.144137:0:16409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958294400 00000100:00100000:0.0:1790919685.144204:0:16409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1790919685.144219:0:16409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6123050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b540191a-9155-42a4-9bf1-c88998854efa+12:15713:x1877914958294400:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1790919685.144463:0:16409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6123050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b540191a-9155-42a4-9bf1-c88998854efa+13:15713:x1877914958294400:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 250us (380us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790919685.144484:0:16409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919685.209431:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919685.210047:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958294528 00000100:00100000:1.0:1790919685.210170:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958294528 00000100:00100000:2.0:1790919685.210444:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1790919685.210456:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+11:15719:x1877914958294528:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919685.210477:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.210497:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390d8 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210584:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210601:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210613:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210623:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210631:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210638:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210728:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1000/0x951c50ad15914d6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210737:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1000/0x951c50ad15914d6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210757:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1000/0x951c50ad15914d6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.210785:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919685.210789:0:16408:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919685.210826:0:16408:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1000/0x951c50ad15914d6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210849:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210856:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210875:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210882:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919685.210887:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210895:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210907:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919685.210910:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919685.210914:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210921:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210934:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210941:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210947:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210959:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919685.210962:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210969:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210977:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95f382b81000) 00010000:00010000:2.0:1790919685.210980:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919685.210983:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.210989:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.211014:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d8 expref: 13 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.211027:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1000/0x951c50ad15914d6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d8 expref: 12 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.211034:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:2.0:1790919685.211037:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919685.211039:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1000, rc 0) 00000100:00100000:2.0:1790919685.211147:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:15719:x1877914958294528:12345-192.168.203.11@tcp:101:bash.0 Request processed in 694us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.211155:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1790919685.215716:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.215827:0:16418:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958294656 00000100:00100000:2.0:1790919685.215850:0:16418:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958294656 00000100:00100000:2.0:1790919685.215907:0:16418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919685.215917:0:16418:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15719:x1877914958294656:12345-192.168.203.11@tcp:900:bash.0 00000100:00100000:2.0:1790919685.216003:0:16418:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15719:x1877914958294656:12345-192.168.203.11@tcp:900:bash.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.216011:0:16418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790919685.219342:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.219439:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958294912 00000100:00100000:2.0:1790919685.219451:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958294912 00000100:00100000:2.0:1790919685.219508:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:2.0:1790919685.219518:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:15719:x1877914958294912:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919685.219540:0:16407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.219560:0:16407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d74 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390df expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.219676:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.219692:0:16407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 12 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.219700:0:16407:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.219735:0:16407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 12 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.219758:0:16407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 12 pid: 18910 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919685.219791:0:16407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16407:1877914978287744:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919685.219882:0:16407:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919685.225575:0:16407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b64faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16407:1877914978287744:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919685.225606:0:16407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919685.226258:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919685.226333:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958295040 00000100:00100000:3.0:1790919685.226341:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958295040 00010000:00010000:3.0:1790919685.226410:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 13 pid: 18910 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919685.226451:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1790919685.226463:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b540191a-9155-42a4-9bf1-c88998854efa+13:2414:x1877914958295040:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919685.226476:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919685.226483:0:16393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 13 pid: 18910 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.226494:0:16393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 13 pid: 18910 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.226516:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914d51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d1 expref: 13 pid: 18910 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.226533:0:16393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:3.0:1790919685.226538:0:16393:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.226548:0:16393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.226576:0:16393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919685.226606:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919685.226657:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b540191a-9155-42a4-9bf1-c88998854efa+12:2414:x1877914958295040:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 197us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919685.226665:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00010000:00010000:0.0:1790919685.226723:0:16407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.226731:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.226757:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.226766:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.226774:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227426:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227436:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227443:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919685.227452:0:16407:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790919685.227478:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227485:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227499:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227505:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919685.227510:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227517:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227526:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:0.0:1790919685.227529:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919685.227533:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227540:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1800/0x951c50ad15914d7b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790919685.227552:0:16407:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009fcc8658 reply state 00000000152f4c86 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227562:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227567:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95f382b81500) 00010000:00010000:0.0:1790919685.227570:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790919685.227572:0:16407:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790919685.227602:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1600/0x951c50ad15914d74 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 15 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227615:0:16407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 14 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.227628:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919685.227630:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790919685.227633:0:16407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030a00, rc 0) 00000100:00100000:0.0:1790919685.227671:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+15:15719:x1877914958294912:12345-192.168.203.11@tcp:101:bash.0 Request processed in 8155us (8340us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790919685.227678:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1790919685.240990:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.241233:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958295168 00000100:00100000:2.0:1790919685.241244:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958295168 00000100:00100000:2.0:1790919685.241302:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790919685.241313:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+15:15719:x1877914958295168:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919685.241338:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.241369:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390e6 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241443:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241457:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241467:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.241502:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790919685.241506:0:16408:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919685.241521:0:16408:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241547:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241570:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914d97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 17 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241587:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 16 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.241595:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919685.241597:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919685.241601:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1e00, rc 0) 00000100:00100000:2.0:1790919685.241660:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+16:15719:x1877914958295168:12345-192.168.203.11@tcp:101:bash.0 Request processed in 350us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.241667:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1790919685.246376:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.246452:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958295424 00000100:00100000:2.0:1790919685.246461:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958295424 00000100:00100000:2.0:1790919685.246517:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790919685.246526:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+16:15719:x1877914958295424:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1790919685.246833:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+17:15719:x1877914958295424:12345-192.168.203.11@tcp:35:bash.0 Request processed in 307us (465us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790919685.246841:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000040:00080000:3.0:1790919685.279336:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919685.322007:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.322208:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958295680 00000100:00100000:2.0:1790919685.322222:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958295680 00000100:00100000:2.0:1790919685.322295:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790919685.322306:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+17:15729:x1877914958295680:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919685.322383:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.322422:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390ed expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.322590:0:18910:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919685.322777:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914da5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ed expref: 19 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.322795:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:2.0:1790919685.322799:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919685.322806:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ed expref: 19 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.322825:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1c00, rc 0) 00000100:00100000:2.0:1790919685.322915:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+18:15729:x1877914958295680:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 610us (923us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1790919685.322924:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1790919685.327247:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.327353:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958295936 00000100:00100000:2.0:1790919685.327367:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958295936 00000100:00100000:2.0:1790919685.327431:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1790919685.327444:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+18:15729:x1877914958295936:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919685.327777:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:15729:x1877914958295936:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 334us (558us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790919685.327786:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919685.374208:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.377458:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958296192 00000100:00100000:2.0:1790919685.377479:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958296192 00000100:00100000:2.0:1790919685.377582:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:2.0:1790919685.377611:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:15732:x1877914958296192:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919685.377776:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.377817:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914db3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390f4 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.377958:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad15914dba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.377978:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad15914dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.377992:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad15914dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.378005:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919685.378322:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914db3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390f4 expref: 22 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.378358:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad15914dba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390f4 expref: 21 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.378369:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919685.378372:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919685.378375:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1200, rc 0) 00000100:00100000:2.0:1790919685.378913:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15732:x1877914958296192:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1301us (4717us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790919685.378923:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1790919685.385224:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.386454:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958296320 00000100:00100000:2.0:1790919685.386473:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958296320 00000100:00100000:2.0:1790919685.386569:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1790919685.386599:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15732:x1877914958296320:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1790919685.387557:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387594:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387607:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387642:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387658:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387667:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387674:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919685.387679:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387687:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387701:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919685.387704:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919685.387710:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.387732:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919685.387889:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15732:x1877914958296320:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 1301us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.387899:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1790919685.389587:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.390159:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958296448 00000100:00100000:0.0:1790919685.390173:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958296448 00000100:00100000:0.0:1790919685.390355:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790919685.390368:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:2412:x1877914958296448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919685.390452:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919685.390484:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad15914dba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390f4 expref: 21 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.390509:0:16392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919685.390515:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919685.390645:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+20:2412:x1877914958296448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 279us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.390654:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790919685.391689:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.392384:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958296704 00000100:00100000:2.0:1790919685.392398:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958296704 00000100:00100000:2.0:1790919685.392455:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919685.392465:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+20:15732:x1877914958296704:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1790919685.392771:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15732:x1877914958296704:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 306us (1086us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790919685.392781:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919685.639807:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.639981:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958296960 00000100:00100000:2.0:1790919685.639992:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958296960 00000100:00100000:2.0:1790919685.640364:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790919685.640376:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15763:x1877914958296960:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1790919685.640400:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.640421:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dcf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f390fb expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.640517:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0a00/0x951c50ad15914dd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.640532:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0a00/0x951c50ad15914dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.640554:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0a00/0x951c50ad15914dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919685.640568:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919685.640716:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1c00/0x951c50ad15914dcf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390fb expref: 24 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.640735:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0a00/0x951c50ad15914dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390fb expref: 23 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.640744:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919685.640746:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919685.640750:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0a00, rc 0) 00000100:00100000:2.0:1790919685.640819:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:15763:x1877914958296960:12345-192.168.203.11@tcp:101:cat.0 Request processed in 445us (1020us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790919685.640827:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1790919685.646604:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919685.646682:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.647506:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958297216 00000100:00100000:2.0:1790919685.647518:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958297216 00000100:00100000:2.0:1790919685.647627:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1790919685.647641:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:15763:x1877914958297216:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:0.0:1790919685.647656:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958297344 00000100:00100000:0.0:1790919685.647662:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958297344 00000100:00100000:0.0:1790919685.647724:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1790919685.647734:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+24:2414:x1877914958297344:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919685.647746:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919685.647782:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0a00/0x951c50ad15914dd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390fb expref: 24 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.647800:0:16393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919685.647804:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919685.647858:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+24:2414:x1877914958297344:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 126us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.647866:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790919685.647928:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:15763:x1877914958297216:12345-192.168.203.11@tcp:35:cat.0 Request processed in 291us (1332us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1790919685.647936:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919685.712748:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.712872:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958297600 00000100:00100000:0.0:1790919685.712882:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958297600 00000100:00100000:0.0:1790919685.712940:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1790919685.712949:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:15769:x1877914958297600:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:0.0:1790919685.712973:0:16407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919685.712994:0:16407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914de4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39102 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713111:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713125:0:16407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 24 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713133:0:16407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 24 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713142:0:16407:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713175:0:16407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 24 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713202:0:16407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 24 pid: 16408 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919685.713215:0:16407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16407:1877914978287872:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919685.713306:0:16407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 24 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.713315:0:16407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 24 pid: 16407 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919685.713324:0:16407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16407:1877914978288000:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919685.713358:0:16407:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919685.716123:0:16407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16407:1877914978287872:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919685.716137:0:16407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:16407:1877914978288000:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919685.716160:0:16407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919685.719774:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919685.719834:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.720086:0:19148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958297728 00000100:00100000:2.0:1790919685.720097:0:19148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958297728 00010000:00010000:2.0:1790919685.720153:0:19148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 25 pid: 16408 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919685.720217:0:19148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958297856 00000100:00100000:2.0:1790919685.720222:0:19148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958297856 00010000:00010000:2.0:1790919685.720236:0:19148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 26 pid: 16407 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919685.720260:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919685.720269:0:19148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:2414:x1877914958297728:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919685.720284:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919685.720290:0:19148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 26 pid: 16408 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.720303:0:19148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 26 pid: 16408 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.720323:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914d9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390e6 expref: 26 pid: 16408 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919685.720327:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:2.0:1790919685.720355:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00000100:00100000:0.0:1790919685.720355:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeb26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+25:2414:x1877914958297856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919685.720363:0:19148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.720373:0:19148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.720378:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919685.720380:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919685.720393:0:16392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 25 pid: 16407 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.720408:0:16392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 25 pid: 16407 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.720433:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914d89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390df expref: 25 pid: 16407 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919685.720436:0:19148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+25:2414:x1877914958297728:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 166us (669us total) trans 0 rc 0/0 00010000:00010000:0.0:1790919685.720454:0:16392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919685.720460:0:16392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919685.720466:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00010000:00010000:0.0:1790919685.720470:0:16392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.720481:0:16392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.720521:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919685.720548:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeb26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:2414:x1877914958297856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 209us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.720555:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:0.0:1790919685.720613:0:16407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.720621:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919685.720638:0:16407:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790919685.722213:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914de4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39102 expref: 24 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.722239:0:16407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39102 expref: 23 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.722263:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919685.722267:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790919685.722270:0:16407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3b6015a00, rc 0) 00000100:00100000:0.0:1790919685.722326:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:15769:x1877914958297600:12345-192.168.203.11@tcp:101:dd.0 Request processed in 9378us (9586us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790919685.722335:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790919685.726848:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.727655:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958298112 00000100:00100000:2.0:1790919685.727666:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958298112 00000100:00100000:1.0:1790919685.727976:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790919685.727991:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+23:15769:x1877914958298112:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:1.0:1790919685.728316:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.728333:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.728356:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919685.728411:0:16405:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1790919685.728439:0:16405:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c99ae0b2 reply state 00000000309918fd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.728451:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919685.728458:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:1.0:1790919685.728461:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919685.728474:0:16405:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919685.729029:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:15769:x1877914958298112:12345-192.168.203.11@tcp:36:dd.0 Request processed in 1041us (2188us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1790919685.729038:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000020:00080000:1.0:1790919685.729043:0:16405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919685.732013:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.732201:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958298240 00000100:00100000:2.0:1790919685.732212:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958298240 00000100:00100000:2.0:1790919685.732259:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790919685.732267:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:15769:x1877914958298240:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1790919685.732288:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.732306:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914e00 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39109 expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.732367:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914e00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39109 expref: 27 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.732380:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914e00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39109 expref: 27 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.732398:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919685.732401:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919685.732404:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0200, rc 0) 00000100:00100000:2.0:1790919685.732460:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15769:x1877914958298240:12345-192.168.203.11@tcp:101:dd.0 Request processed in 193us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.732467:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790919685.745760:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919685.745868:0:19148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958298496 00000100:00100000:0.0:1790919685.745878:0:19148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958298496 00000100:00100000:0.0:1790919685.745961:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790919685.745977:0:19148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15769:x1877914958298496:12345-192.168.203.11@tcp:103:dd.0 00010000:00010000:0.0:1790919685.745994:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919685.746024:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914e00 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39109 expref: 27 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919685.746042:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:0.0:1790919685.746046:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919685.746184:0:19148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:15769:x1877914958298496:12345-192.168.203.11@tcp:103:dd.0 Request processed in 213us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919685.746192:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1790919685.749191:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.750668:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958298624 00000100:00100000:2.0:1790919685.750681:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958298624 00000100:00100000:2.0:1790919685.751292:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1790919685.751318:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:15769:x1877914958298624:12345-192.168.203.11@tcp:58:dd.0 00010000:00010000:2.0:1790919685.751426:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.751443:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.751454:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919685.752200:0:16408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919685.752365:0:16408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1790919685.752438:0:16408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1790919685.752550:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:15769:x1877914958298624:12345-192.168.203.11@tcp:58:dd.0 Request processed in 1234us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.752560:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:1.0:1790919685.755815:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919685.755958:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958298752 00000100:00100000:2.0:1790919685.755967:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958298752 00000100:00100000:2.0:1790919685.756016:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1790919685.756025:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+26:15769:x1877914958298752:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1790919685.756044:0:16408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919685.756074:0:16408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39110 expref: -99 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.756125:0:16408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.756135:0:16408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 27 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.756171:0:16408:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.756183:0:16408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 27 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.756197:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919685.756200:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790919685.756203:0:16408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 27 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919685.756211:0:16408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1400, rc 0) 00000100:00100000:2.0:1790919685.756274:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15769:x1877914958298752:12345-192.168.203.11@tcp:101:dd.0 Request processed in 246us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919685.756281:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00010000:00010000:0.0:1790919685.788243:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919686.087573:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.087693:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.087739:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.087792:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.087815:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.087859:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299136 00000100:00100000:2.0:1790919686.087873:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299136 00000100:00100000:3.0:1790919686.087971:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.087994:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.088019:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.088177:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299008 00000100:00100000:3.0:1790919686.088182:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299008 00000100:00100000:3.0:1790919686.088233:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299392 00000100:00100000:3.0:1790919686.088236:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299392 00000100:00100000:3.0:1790919686.088252:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299520 00000100:00100000:3.0:1790919686.088254:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299520 00000100:00100000:2.0:1790919686.088278:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299264 00000100:00100000:3.0:1790919686.088284:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790919686.088285:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299264 00000100:00100000:3.0:1790919686.088300:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2413:x1877914958299008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919686.088307:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299648 00000100:00100000:2.0:1790919686.088321:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299648 00000100:00100000:2.0:1790919686.088349:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299776 00000100:00100000:2.0:1790919686.088352:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299776 00000100:00100000:2.0:1790919686.088373:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919686.088380:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958299136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919686.088418:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2413:x1877914958299008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 121us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.088427:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958299136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.088431:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790919686.088449:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1790919686.088454:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:3.0:1790919686.088465:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+12:2414:x1877914958299392:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919686.088471:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919686.088479:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2413:x1877914958299264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919686.088509:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+12:2414:x1877914958299392:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.088516:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2413:x1877914958299264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.088522:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1790919686.088528:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1790919686.088546:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1790919686.088546:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790919686.088561:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+5:2413:x1877914958299520:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919686.088562:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958299648:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919686.088602:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b540191a-9155-42a4-9bf1-c88998854efa+5:2413:x1877914958299520:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.088608:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00080000:3.0:1790919686.088650:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919686.088657:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919686.088660:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919686.088663:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919686.088706:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919686.088733:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2413:x1877914958299776:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919686.089118:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958299648:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 558us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.090489:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1790919686.092321:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958298880 00000100:00100000:1.0:1790919686.092352:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958298880 00000100:00100000:1.0:1790919686.092446:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:1.0:1790919686.092458:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958298880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919686.092610:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958298880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 154us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.092620:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:0.0:1790919686.095827:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2413:x1877914958299776:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7095us (7794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.095861:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000040:00080000:1.0:1790919686.108932:0:16440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919686.108947:0:16440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919686.109042:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790919686.109159:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790919686.109332:0:16440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:16440:1877914978288128:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790919686.109714:0:16440:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383ece900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919686.111837:0:16440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:16440:1877914978288128:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919686.117428:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.117893:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958299904 00000100:00100000:3.0:1790919686.117907:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958299904 00000100:00100000:3.0:1790919686.118114:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790919686.118126:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15770:x1877914958299904:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919686.118169:0:16405:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919686.118310:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15770:x1877914958299904:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 186us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.118320:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00080000:1.0:1790919686.119672:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919686.128898:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.128988:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958300032 00000100:00100000:3.0:1790919686.129003:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958300032 00000100:00100000:3.0:1790919686.129132:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790919686.129159:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15770:x1877914958300032:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790919686.129265:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.129290:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.129307:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136586:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136611:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136624:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136659:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136686:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136694:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919686.136737:0:16408:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790919686.136742:0:16408:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919686.136754:0:16408:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136766:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136773:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136780:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136785:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.136790:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136797:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136808:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919686.136811:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.136815:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136830:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c400/0x951c50ad15914e15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136846:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136852:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136857:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136862:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.136865:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136871:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136879:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff95f3a2027d00) 00010000:00010000:3.0:1790919686.136881:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.136885:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136890:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136905:0:16408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136911:0:16408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136923:0:16408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136928:0:16408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.136931:0:16408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136937:0:16408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136946:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:3.0:1790919686.136948:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.136951:0:16408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.136958:0:16408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.137091:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15770:x1877914958300032:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 7942us (8211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.137102:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1790919686.140933:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.141412:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958300288 00000100:00100000:3.0:1790919686.141426:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958300288 00000100:00100000:2.0:1790919686.141669:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1790919686.141691:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+27:15770:x1877914958300288:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919686.141722:0:16405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919686.141759:0:16405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39117 expref: -99 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.141884:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.141903:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.141936:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919686.141951:0:16405:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790919686.142132:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142142:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142150:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142157:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919686.142162:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142170:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142185:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919686.142193:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790919686.142199:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142206:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad15914e31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142260:0:16405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e2a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39117 expref: 29 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142284:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f382b81800) 00010000:00010000:2.0:1790919686.142287:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919686.142292:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39117 expref: 29 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.142302:0:16405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0000, rc 0) 00000100:00100000:2.0:1790919686.142409:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+28:15770:x1877914958300288:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 729us (1489us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1790919686.142419:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1790919686.146269:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.146334:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958300416 00000100:00100000:3.0:1790919686.146356:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958300416 00000100:00100000:3.0:1790919686.146439:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1790919686.146450:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+28:15770:x1877914958300416:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919686.146498:0:16407:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919686.146638:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+28:15770:x1877914958300416:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 190us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.146665:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1790919686.152580:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.154929:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958300672 00000100:00100000:0.0:1790919686.154949:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958300672 00000100:00100000:0.0:1790919686.155248:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790919686.155262:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+28:15770:x1877914958300672:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919686.155293:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919686.155324:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914e3f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3911e expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790919686.156257:0:18910:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1790919686.156266:0:18910:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1790919686.156323:0:18910:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1790919686.156654:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.156672:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.156687:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.156762:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015600/0x951c50ad15914e3f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3911e expref: 31 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.156784:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3911e expref: 30 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.156795:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:0.0:1790919686.156805:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790919686.156810:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030c00, rc 0) 00000100:00100000:0.0:1790919686.156904:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+30:15770:x1877914958300672:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1644us (4338us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1790919686.156914:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790919686.168844:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.168963:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958300928 00000100:00100000:3.0:1790919686.168976:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958300928 00000100:00100000:3.0:1790919686.169144:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790919686.169156:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+30:15770:x1877914958300928:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919686.169234:0:16407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919686.169268:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3911e expref: 30 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.169293:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:3.0:1790919686.169307:0:16407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919686.169336:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.169361:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.169372:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172397:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172421:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172434:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172532:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172541:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172547:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172553:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.172557:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172565:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172577:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:3.0:1790919686.172580:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.172585:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172590:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e54 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172604:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172610:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172616:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172628:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.172632:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172638:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172646:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9a74be18 (ffff95f3a2027d00) 00010000:00010000:3.0:1790919686.172649:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.172652:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.172657:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c200/0x951c50ad15914e5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9a74be18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.172777:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+29:15770:x1877914958300928:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 3619us (3944us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919686.172786:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:3.0:1790919686.180232:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.180455:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958301056 00000100:00100000:2.0:1790919686.180465:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958301056 00000100:00100000:0.0:1790919686.180906:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1790919686.180934:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+29:15770:x1877914958301056:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919686.180966:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919686.181002:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914e62 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39125 expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.181095:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.181112:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.181126:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.181257:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030a00/0x951c50ad15914e62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39125 expref: 31 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.181288:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39125 expref: 30 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.181300:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:0.0:1790919686.181311:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790919686.181316:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f380030c00, rc 0) 00000100:00100000:0.0:1790919686.181480:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+30:15770:x1877914958301056:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 557us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.181492:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1790919686.187746:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.187846:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958301312 00000100:00100000:2.0:1790919686.187858:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958301312 00000100:00100000:2.0:1790919686.187917:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1790919686.187928:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+30:15770:x1877914958301312:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919686.188011:0:16408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.188036:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.188047:0:16408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919686.188498:0:16408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1790919686.188508:0:16408:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 495216455279ns, next at 496216452905ns, rc = 0 00000004:00010000:2.0:1790919686.188603:0:16408:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fcdf3068 reply state 00000000b821fb73 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.188617:0:16408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.188625:0:16408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:2.0:1790919686.188628:0:16408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790919686.188631:0:16408:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919686.188735:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+32:15770:x1877914958301312:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 808us (1006us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790919686.188743:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1790919686.196932:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.197601:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958301440 00000100:00100000:0.0:1790919686.197615:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958301440 00000100:00100000:1.0:1790919686.197884:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1790919686.197896:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+32:15770:x1877914958301440:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919686.197933:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919686.197977:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3912c expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.198151:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 33 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.198168:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 33 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.198191:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:1.0:1790919686.198195:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919686.198199:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1de00, rc 0) 00000100:00100000:1.0:1790919686.198331:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+33:15770:x1877914958301440:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 437us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.198349:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1790919686.202893:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.206632:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958301568 00000100:00100000:3.0:1790919686.206653:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958301568 00000100:00100000:2.0:1790919686.207404:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790919686.207421:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958301568:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790919686.207802:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2414:x1877914958301568:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 385us (4922us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790919686.207811:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1790919686.210655:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919686.210952:0:16409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958301824 00000100:00100000:1.0:1790919686.210963:0:16409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958301824 00000100:00100000:1.0:1790919686.211022:0:16409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919686.211033:0:16409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+33:15770:x1877914958301824:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790919686.211641:0:16409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+34:15770:x1877914958301824:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 607us (991us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1790919686.211650:0:16409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919686.216518:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.216586:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958302080 00000100:00100000:2.0:1790919686.216597:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958302080 00000100:00100000:2.0:1790919686.216651:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790919686.216672:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+34:15770:x1877914958302080:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790919686.216974:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+34:15770:x1877914958302080:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 313us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.216983:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1790919686.222709:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919686.223276:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958302208 00000100:00100000:1.0:1790919686.223286:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958302208 00000100:00100000:1.0:1790919686.223359:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1790919686.223370:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+34:15770:x1877914958302208:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919686.223411:0:18910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919686.223432:0:18910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15914e7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39133 expref: -99 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.223501:0:18910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914e85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.223516:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914e85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.223527:0:18910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914e85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919686.223562:0:18910:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919686.223580:0:18910:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914e85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.223606:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1ca00/0x951c50ad15914e7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39133 expref: 36 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.223626:0:18910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914e85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39133 expref: 35 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.223635:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:1.0:1790919686.223638:0:18910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790919686.223641:0:18910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1cc00, rc 0) 00000100:00100000:1.0:1790919686.223718:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+35:15770:x1877914958302208:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 350us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.223725:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1790919686.225993:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.226132:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958302336 00000100:00100000:3.0:1790919686.226142:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958302336 00000100:00100000:3.0:1790919686.226195:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:3.0:1790919686.226205:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b40f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+6:2414:x1877914958302336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919686.226222:0:17714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919686.226241:0:17714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3913a expref: -99 pid: 17714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919686.226275:0:17714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf4406, blocks: 0x1 00010000:00010000:3.0:1790919686.226294:0:17714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1790919686.226299:0:17714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.226308:0:17714:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 7 pid: 17714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.226325:0:17714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 7 pid: 17714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.226337:0:17714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c200, rc 0) 00000100:00100000:3.0:1790919686.226405:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b40f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2414:x1877914958302336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.226412:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919686.228586:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.228673:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958302592 00000100:00100000:3.0:1790919686.228682:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958302592 00000100:00100000:3.0:1790919686.228738:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790919686.228758:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+35:15770:x1877914958302592:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919686.228869:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+35:15770:x1877914958302592:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.228876:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:1.0:1790919686.232525:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.232657:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958302720 00000100:00100000:2.0:1790919686.232678:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958302720 00000100:00100000:2.0:1790919686.232760:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1790919686.232775:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+35:15770:x1877914958302720:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790919686.263925:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1790919686.263957:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1790919686.264002:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.264135:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.264146:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.264153:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919686.264158:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.264166:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.264182:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:0.0:1790919686.264185:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790919686.264190:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.264213:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15914d27 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919686.264463:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+30:15770:x1877914958302720:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 31684us (31942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.264474:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00010000:00010000:3.0:1790919686.266277:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266299:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266322:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266329:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.266336:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266356:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266371:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff95f382b81000) 00010000:00010000:3.0:1790919686.266375:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.266379:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266386:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030200/0x951c50ad15914cd3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266410:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266417:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266422:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266427:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.266430:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266447:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266457:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:3.0:1790919686.266460:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.266464:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266470:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030800/0x951c50ad15914cda lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266484:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266491:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266497:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266503:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.266506:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266512:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266519:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff95f382b81500) 00010000:00010000:3.0:1790919686.266521:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.266524:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266535:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914d82 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266551:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266557:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266564:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266569:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1dc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.266572:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266578:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266586:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:3.0:1790919686.266588:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919686.266591:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266596:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1dc00/0x951c50ad15914df9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266607:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266613:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266625:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266630:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919686.266633:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266639:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266647:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:3.0:1790919686.266819:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919686.266824:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.266830:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0000/0x951c50ad15914e70 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919686.267024:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1790919686.267049:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790919686.267612:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978288256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919686.267673:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919686.267774:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978288256 00000100:00100000:3.0:1790919686.267782:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978288256 00000100:00100000:3.0:1790919686.267845:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790919686.267854:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978288256:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1790919686.267963:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1790919686.267999:0:17711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790919686.268003:0:17711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790919686.268005:0:17711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790919686.268007:0:17711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790919686 -> 1790919686 00002000:00010000:3.0:1790919686.268009:0:17711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790919686.268249:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978288256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 395us (574us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790919686.268270:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:0.0:1790919686.268441:0:3458:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f391516a00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1790919686.268448:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978288256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790919686.268693:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.268733:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958302848 00000100:00100000:3.0:1790919686.268739:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958302848 00000100:00100000:3.0:1790919686.268792:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1790919686.268800:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2413:x1877914958302848:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790919686.268873:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2413:x1877914958302848:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.268879:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790919686.270937:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.272454:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958303104 00000100:00100000:3.0:1790919686.272468:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958303104 00000100:00100000:3.0:1790919686.272536:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1790919686.272546:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+14:15770:x1877914958303104:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919686.272602:0:16407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919686.272628:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1cc00/0x951c50ad15914e85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39133 expref: 14 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.272647:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:3.0:1790919686.272652:0:16407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919686.272679:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.272692:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.272701:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919686.273038:0:16407:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d54f78ae reply state 0000000019ddb727 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.273103:0:16407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.273111:0:16407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:3.0:1790919686.273113:0:16407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790919686.273115:0:16407:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919686.273281:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+15:15770:x1877914958303104:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 735us (2350us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790919686.273288:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790919686.279106:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.279189:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958303232 00000100:00100000:2.0:1790919686.279199:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958303232 00000100:00100000:2.0:1790919686.279259:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1790919686.279270:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:15770:x1877914958303232:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790919686.279288:0:17712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919686.279317:0:17712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39141 expref: -99 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.279361:0:17712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 8 pid: 17714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.279371:0:17712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919686.279375:0:17712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919686.279380:0:17712:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 8 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.279413:0:17712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 8 pid: 17714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.279426:0:17712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 8 pid: 17714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.279439:0:17712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:17712:1877914978288384:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919686.279541:0:17712:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f385384900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919686.284356:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.284442:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958303360 00000100:00100000:0.0:1790919686.284451:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958303360 00010000:00010000:0.0:1790919686.284508:0:16392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 9 pid: 17714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.284549:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1790919686.284559:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:2413:x1877914958303360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919686.284574:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919686.284596:0:16392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 9 pid: 17714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.284610:0:16392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 9 pid: 17714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.284635:0:16392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919686.284652:0:16392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919686.284659:0:16392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 9 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.284671:0:16392:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 9 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.284706:0:16392:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 9 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.284722:0:16392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:16392:1877914978288512:192.168.203.11@tcp:105: 00000100:00100000:0.0:1790919686.287462:0:16392:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04180 going to sleep for 11 seconds 00010000:00010000:2.0:1790919686.287784:0:17712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9eae9c0/0x951c50ad15914e8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3913a expref: 9 pid: 17714 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.287804:0:17712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:17712:1877914978288384:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919686.287835:0:17712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 8 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.287849:0:17712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0c00, rc 0) 00000100:00100000:2.0:1790919686.287915:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+8:15770:x1877914958303232:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 8647us (8816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.287925:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790919686.294438:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919686.298150:0:16392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:16392:1877914978288512:192.168.203.11@tcp:105: 00010000:00010000:1.0:1790919686.298179:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919686.298247:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2413:x1877914958303360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 13688us (13908us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.298258:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919686.299457:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958303488 00000100:00100000:2.0:1790919686.299468:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958303488 00000100:00100000:2.0:1790919686.299519:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1790919686.299528:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2414:x1877914958303488:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790919686.301516:0:17918:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790919686.301525:0:17918:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790919686 00002000:00010000:2.0:1790919686.301529:0:17918:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790919685 00002000:00010000:2.0:1790919686.301531:0:17918:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790919686 -> 1790919686 00002000:00010000:2.0:1790919686.301533:0:17918:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790919686.301656:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+8:2414:x1877914958303488:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 2125us (7224us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790919686.301666:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790919686.315707:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.315861:0:17711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958303616 00000100:00100000:3.0:1790919686.315872:0:17711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958303616 00000100:00100000:3.0:1790919686.315932:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790919686.315942:0:17711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+8:2413:x1877914958303616:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790919686.315987:0:17711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.316315:0:17711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 8 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.316325:0:17711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.316329:0:17711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790919686.316333:0:17711:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.316461:0:17711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 8 pid: 17712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.316476:0:17711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 8 pid: 17712 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.316491:0:17711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:17711:1877914978288640:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919686.316774:0:17711:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3851e4000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919686.323907:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.325716:0:19148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958303744 00000100:00100000:0.0:1790919686.325732:0:19148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958303744 00010000:00010000:0.0:1790919686.325807:0:19148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 9 pid: 17712 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.325854:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790919686.325864:0:19148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:2414:x1877914958303744:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919686.325878:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919686.325901:0:19148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 9 pid: 17712 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.325915:0:19148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 9 pid: 17712 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.325954:0:19148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919686.325958:0:19148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790919686.325964:0:19148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.325985:0:19148:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.326015:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919686.326113:0:19148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:2414:x1877914958303744:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 249us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.326121:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00010000:00010000:3.0:1790919686.328106:0:17711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001764f303/0x951c50ad15914e9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39141 expref: 8 pid: 17712 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.328212:0:17711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:17711:1877914978288640:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919686.328238:0:17711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328351:0:17711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328375:0:17711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328469:0:17711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328479:0:17711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328488:0:17711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328495:0:17711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919686.328499:0:17711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328508:0:17711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328525:0:17711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.328532:0:17711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080f62c9d/0x951c50ad15914ea1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.328633:0:17711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2413:x1877914958303616:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 12691us (12934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.328643:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1790919686.330583:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.331006:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304000 00000100:00100000:2.0:1790919686.331016:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304000 00000100:00100000:2.0:1790919686.331151:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1790919686.331162:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+15:15770:x1877914958304000:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790919686.331243:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331260:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331271:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331512:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331524:0:16405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 16 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331532:0:16405:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331565:0:16405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 16 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.331590:0:16405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 16 pid: 18910 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.331604:0:16405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16405:1877914978288768:192.168.203.11@tcp:104: 00000100:00100000:2.0:1790919686.331681:0:16405:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f385384900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919686.337283:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.338518:0:16405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16405:1877914978288768:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919686.338541:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304128 00000100:00100000:0.0:1790919686.338552:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304128 00010000:00010000:2.0:1790919686.338562:0:16405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338612:0:16393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 17 pid: 18910 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.338650:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1790919686.338661:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+17:2413:x1877914958304128:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919686.338678:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919686.338684:0:16393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 17 pid: 18910 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338696:0:16393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 17 pid: 18910 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338737:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1de00/0x951c50ad15914e77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3912c expref: 17 pid: 18910 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338752:0:16393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:0.0:1790919686.338756:0:16393:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338766:0:16393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338773:0:16393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.338801:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919686.338859:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+16:2413:x1877914958304128:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 200us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.338869:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00010000:00010000:2.0:1790919686.338871:0:16405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.338881:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919686.339080:0:16405:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1790919686.340598:0:16405:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1790919686.340683:0:16405:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1790919686.340835:0:16405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16405:1877914978288896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790919686.340922:0:16405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.340963:0:16405:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919686.341028:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978288896 00000100:00100000:0.0:1790919686.341044:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978288896 00000100:00100000:0.0:1790919686.341142:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790919686.341152:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16405:x1877914978288896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790919686.341289:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16405:x1877914978288896:12345-0@lo:1000:mdt00_000.0 Request processed in 138us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.341297:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790919686.341468:0:16405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16405:1877914978288896:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790919686.345634:0:16405:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1790919686.345731:0:16405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16405:1877914978289024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790919686.345876:0:16405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.345912:0:16405:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391854240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919686.345988:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289024 00000100:00100000:0.0:1790919686.345995:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289024 00000100:00100000:0.0:1790919686.346046:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919686.346085:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16405:x1877914978289024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790919686.347590:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16405:x1877914978289024:12345-0@lo:1000:mdt00_000.0 Request processed in 1506us (1713us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790919686.347600:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790919686.347857:0:16405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:16405:1877914978289024:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790919686.347901:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.347911:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.347918:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.347924:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919686.347928:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.347951:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.347965:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:1.0:1790919686.347969:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919686.347973:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.347979:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1e00/0x951c50ad15914eaf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.348009:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.348014:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.348020:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.348026:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919686.348029:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.348035:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.348043:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:1.0:1790919686.348045:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919686.349483:0:16405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 19 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.349522:0:16405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 19 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.349532:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 19 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.349612:0:16405:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 19 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919686.349627:0:16405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16405:1877914978289152:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790919686.349717:0:16405:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921a9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919686.357638:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.357713:0:16405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:16405:1877914978289152:192.168.203.11@tcp:105: 00010000:00010000:2.0:1790919686.357739:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357749:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0800/0x951c50ad15914e07 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357791:0:16405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357804:0:16405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357814:0:16405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357825:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357831:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357837:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357842:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919686.357846:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357853:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357868:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919686.357884:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919686.357889:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357895:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1a00/0x951c50ad15914eb6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357906:0:16405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357911:0:16405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357918:0:16405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357923:0:16405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919686.357926:0:16405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357932:0:16405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357941:0:16405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:2.0:1790919686.357943:0:16405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790919686.357946:0:16405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.357951:0:16405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15914ea8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.358279:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:15770:x1877914958304000:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 27118us (27702us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790919686.358297:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:2.0:1790919686.358303:0:16405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790919686.358352:0:16440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919686.358357:0:16440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919686.358383:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790919686.358389:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790919686.359922:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304256 00000100:00100000:3.0:1790919686.359932:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304256 00000100:00100000:3.0:1790919686.359986:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790919686.359995:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6122050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:15769:x1877914958304256:12345-192.168.203.11@tcp:49:dd.0 00000100:00100000:3.0:1790919686.361353:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6122050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:15769:x1877914958304256:12345-192.168.203.11@tcp:49:dd.0 Request processed in 1336us (3701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.361366:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919686.363423:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.363512:0:16409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304512 00000100:00100000:0.0:1790919686.363521:0:16409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304512 00000100:00100000:0.0:1790919686.363574:0:16409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790919686.363583:0:16409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:15770:x1877914958304512:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790919686.367915:0:16409:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790919686.368024:0:16409:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1790919686.368111:0:16409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.368129:0:16409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.368140:0:16409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.368147:0:16409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.368153:0:16409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.368315:0:16409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.368334:0:16409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790919686.368462:0:16409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15770:x1877914958304512:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 4876us (5042us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790919686.368483:0:16409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000020:00080000:0.0:1790919686.368489:0:16409:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790919686.368712:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919686.368719:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.368726:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919686.368730:0:16394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.368748:0:16394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.368771:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:1.0:1790919686.368774:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790919686.368779:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.368785:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030400/0x951c50ad15914ebd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.368798:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919686.368800:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919686.368802:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919686.526599:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.526657:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919686.526870:0:17718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304640 00000100:00100000:1.0:1790919686.526879:0:17718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304640 00000100:00100000:1.0:1790919686.526932:0:17718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304768 00000100:00100000:1.0:1790919686.526935:0:17718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304768 00000100:00100000:1.0:1790919686.526950:0:17718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790919686.526958:0:17718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+8:2412:x1877914958304640:12345-192.168.203.11@tcp:4:dd.0 00002000:00010000:1.0:1790919686.527003:0:17718:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6abf4406, atime: 0x6abf4405, ctime: 0x6abf4406, blocks: 0x1 00010000:00010000:1.0:1790919686.527011:0:17718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.527028:0:17718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1790919686.527032:0:17718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919686.527037:0:17718:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.527087:0:17718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.528847:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.529029:0:17719:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790919686.529039:0:17719:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1790919686.532639:0:17719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958304896 00000100:00100000:0.0:1790919686.532652:0:17719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958304896 00000100:00100000:1.0:1790919686.534847:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1790919686.534864:0:19265:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+10:2412:x1877914958304768:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:1.0:1790919686.534903:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.534921:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919686.534925:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919686.534932:0:19265:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.534945:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.556672:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978289408:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.556745:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.556778:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978289920:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.556805:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.556825:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978290432:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.556848:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.556874:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790919686.556880:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978289536:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.556904:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.556920:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978290048:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.556939:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.556953:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978290560:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.556973:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.557005:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289408 00000100:00100000:0.0:1790919686.557013:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289408 00000100:00100000:0.0:1790919686.557082:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919686.557091:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978289408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.557156:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978289408:12345-0@lo:400:kworker.0 Request processed in 66us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.557175:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790919686.557199:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978289664:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.557225:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.557282:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978289280:0@lo:400:kworker.0 00000100:00100000:2.0:1790919686.557321:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.557365:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978289792:0@lo:400:kworker.0 00000100:00100000:1.0:1790919686.557726:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289920 00000100:00100000:1.0:1790919686.557732:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289920 00000100:00100000:1.0:1790919686.557768:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289536 00000100:00100000:1.0:1790919686.557771:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289536 00000100:00100000:1.0:1790919686.557786:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290048 00000100:00100000:1.0:1790919686.557789:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290048 00000100:00100000:1.0:1790919686.557803:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919686.557810:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919686.557852:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978289920:12345-0@lo:400:kworker.0 Request processed in 42us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.557859:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919686.557875:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919686.557882:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978289536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919686.557934:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978289536:12345-0@lo:400:kworker.0 Request processed in 52us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.557940:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919686.557954:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919686.557959:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919686.557989:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978290048:12345-0@lo:400:kworker.0 Request processed in 30us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.557996:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790919686.558014:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919686.558017:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919686.558026:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290432 00000100:00100000:1.0:1790919686.558030:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290432 00000100:00080000:1.0:1790919686.558048:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919686.558505:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.558535:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978290304:0@lo:400:kworker.0 00000100:00100000:2.0:1790919686.558564:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.558602:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978290816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919686.559243:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919686.559330:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289280 00000100:00100000:2.0:1790919686.559346:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289280 00000100:00100000:2.0:1790919686.559382:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790919686.560656:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978290176:0@lo:400:kworker.0 00000100:00100000:2.0:1790919686.560733:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978289280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919686.560805:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978289280:12345-0@lo:400:kworker.0 Request processed in 82us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.560814:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790919686.560864:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290816 00000100:00100000:2.0:1790919686.560870:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290816 00000100:00100000:2.0:1790919686.560901:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919686.560908:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978290816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790919686.560923:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 54329344 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919686.560967:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978290816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.560976:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790919686.560978:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.560997:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978290688:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.561028:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.561238:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290560 00000100:00100000:0.0:1790919686.561243:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290560 00000100:00080000:1.0:1790919686.562183:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919686.562221:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290304 00000100:00100000:0.0:1790919686.562221:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289664 00000100:00100000:1.0:1790919686.562226:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290304 00000100:00100000:0.0:1790919686.562226:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289664 00000100:00100000:0.0:1790919686.562243:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290176 00000100:00100000:0.0:1790919686.562246:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290176 00000100:00100000:3.0:1790919686.562383:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978289792 00000100:00100000:3.0:1790919686.562396:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978289792 00000100:00100000:3.0:1790919686.562439:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790919686.562448:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978289792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.562484:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290688 00000100:00100000:0.0:1790919686.562492:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290688 00000100:00100000:3.0:1790919686.562555:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978289792:12345-0@lo:400:kworker.0 Request processed in 106us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.562563:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790919686.562647:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919686.562656:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978290560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790919686.562671:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919686.562677:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919686.562701:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790919686.562716:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3460:x1877914978290560:12345-0@lo:400:kworker.0 Request processed in 56us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.562717:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978290432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.562913:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978290432:12345-0@lo:400:kworker.0 Request processed in 203us (6062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919686.563276:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978290816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919686.563289:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978289280:0@lo:400:kworker.0 00000100:00100000:2.0:1790919686.563363:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978289792:0@lo:400:kworker.0 00000100:00100000:2.0:1790919686.563688:0:16405:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790919686.563697:0:16405:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790919686.564085:0:16407:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790919686.564096:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790919686.564105:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978289664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919686.564151:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790919686.564201:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790919686.564225:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919686.564232:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978290176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919686.564328:0:16408:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1790919686.564355:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790919686.564367:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978290688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.564526:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978290176:12345-0@lo:400:kworker.0 Request processed in 287us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.564535:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919686.564553:0:18910:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919686.564569:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919686.564578:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978290304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.564625:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978290304:12345-0@lo:400:kworker.0 Request processed in 49us (6061us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.564631:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919686.564682:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978290304:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.564710:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978291072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919686.564745:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.564783:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919686.564790:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978290944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919686.564816:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919686.564843:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291072 00000100:00100000:0.0:1790919686.564849:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291072 00000100:00100000:0.0:1790919686.564870:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978290944 00000100:00100000:0.0:1790919686.564873:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978290944 00000100:00100000:0.0:1790919686.564884:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919686.564890:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978291072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919686.564916:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1790919686.564952:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978291072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.564958:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790919686.564969:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919686.564974:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978290944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919686.564983:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1790919686.565005:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978290944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919686.565020:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919686.565091:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978290944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919686.565104:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978291072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919686.565134:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978289536:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.565144:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978290048:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.565154:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3460:1877914978290560:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.565164:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978289408:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.565176:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978289920:0@lo:400:kworker.0 00010000:00080000:0.0:1790919686.565189:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c09880 x1877914978290432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919686.565199:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978290432:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.565238:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978289664:0@lo:400:kworker.0 00000100:00100000:0.0:1790919686.565250:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978290176:0@lo:400:kworker.0 00000100:00100000:1.0:1790919686.566160:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f398da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978289664:12345-0@lo:400:kworker.0 Request processed in 2053us (8930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919686.566170:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790919686.568494:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978290688:12345-0@lo:400:kworker.0 Request processed in 4116us (7450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919686.568514:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1790919686.570908:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c0ad80 x1877914978290688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919686.570927:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978290688:0@lo:400:kworker.0 00000001:00080000:3.0:1790919686.648836:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1790919686.648873:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1790919686.650120:0:17718:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1790919686.650129:0:17718:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1790919686 -> 1790919687 00002000:00010000:2.0:1790919686.650132:0:17718:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1790919686.650150:0:17718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650166:0:17718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650176:0:17718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650184:0:17718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919686.650189:0:17718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650199:0:17718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650223:0:17718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650251:0:17718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a935905/0x951c50ad15914ec4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.650384:0:17718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+10:2412:x1877914958304640:12345-192.168.203.11@tcp:4:dd.0 Request processed in 123418us (123785us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790919686.650403:0:17718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1790919686.650445:0:17718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790919686.650461:0:17718:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:2412:x1877914958304896:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:2.0:1790919686.650503:0:17718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650517:0:17718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919686.650521:0:17718:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919686.650529:0:17718:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.650542:0:17718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919686.739706:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1790919686.741306:0:19265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1790919686.741314:0:19265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1790919686.741408:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.741424:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.741450:0:19265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.741458:0:19265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1c000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919686.741462:0:19265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.741473:0:19265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.741493:0:19265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.741500:0:19265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8ace1d2/0x951c50ad15914ecb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.741597:0:19265:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:2412:x1877914958304768:12345-192.168.203.11@tcp:4:dd.0 Request processed in 206735us (214936us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1790919686.741614:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000001:00080000:0.0:1790919686.801637:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1790919686.801964:0:17718:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1790919686.801989:0:17718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.802005:0:17718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.802129:0:17718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.802138:0:17718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919686.802144:0:17718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.802155:0:17718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.802178:0:17718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.802187:0:17718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3663240/0x951c50ad15914ed2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.802346:0:17718:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958304896:12345-192.168.203.11@tcp:4:dd.0 Request processed in 151876us (273491us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790919686.802359:0:17718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790919686.807930:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919686.809248:0:17719:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305024 00000100:00100000:0.0:1790919686.809263:0:17719:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305024 00000100:00100000:0.0:1790919686.809402:0:17719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919686.809426:0:17719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2411:x1877914958305024:12345-192.168.203.11@tcp:4:dd.0 00002000:00010000:0.0:1790919686.809476:0:17719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abf4407, atime: 0x6abf4405, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1790919686.809486:0:17719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.809502:0:17719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1790919686.809506:0:17719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919686.809512:0:17719:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.809526:0:17719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.813252:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1790919686.813293:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919686.813369:0:19265:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305152 00000100:00100000:3.0:1790919686.813391:0:19265:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305152 00000100:00100000:3.0:1790919686.813477:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790919686.813490:0:19265:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+7:2411:x1877914958305152:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:3.0:1790919686.813524:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.813559:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.813563:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.813571:0:19265:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.813583:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.816140:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919686.816175:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.816239:0:17717:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1790919686.816249:0:17717:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1790919686.816556:0:17718:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919686.816567:0:17718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305280 00000100:00100000:0.0:1790919686.816575:0:17718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305280 00000100:00100000:0.0:1790919686.816624:0:17718:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919686.816630:0:17718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305408 00000100:00100000:0.0:1790919686.816633:0:17718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305408 00000100:00100000:3.0:1790919686.817172:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1790919686.817187:0:19269:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+10:2411:x1877914958305280:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:3.0:1790919686.817222:0:19269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.817240:0:19269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.817258:0:19269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.817265:0:19269:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.817278:0:19269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.827078:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919686.828049:0:17718:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1790919686.828074:0:17718:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1790919686.834701:0:17718:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305536 00000100:00100000:0.0:1790919686.834715:0:17718:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305536 00000100:00100000:3.0:1790919686.836748:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790919686.836788:0:19270:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e183cc62-cefd-4e26-96c7-4234fcebe0d8+14:2411:x1877914958305408:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:3.0:1790919686.836833:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.836849:0:19270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.836853:0:19270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919686.836860:0:19270:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.836875:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919686.890642:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1790919686.890845:0:17719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:0.0:1790919686.890850:0:17719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 0 -> 1790919687 00002000:00010000:0.0:1790919686.890852:0:17719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1790919686.890868:0:17719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.890881:0:17719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.890897:0:17719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.890904:0:17719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919686.890909:0:17719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.890917:0:17719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.890937:0:17719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.890945:0:17719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000538f7c9/0x951c50ad15914ed9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.891031:0:17719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+18:2411:x1877914958305024:12345-192.168.203.11@tcp:4:dd.0 Request processed in 81603us (83112us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1790919686.891041:0:17719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919686.891105:0:17719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790919686.891117:0:17719:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+17:2411:x1877914958305536:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:0.0:1790919686.891149:0:17719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.891160:0:17719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919686.891170:0:17719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919686.891177:0:17719:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.891190:0:17719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790919686.936864:0:19269:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1790919686.936886:0:19269:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:2.0:1790919686.936902:0:19269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.936916:0:19269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.936927:0:19269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.936934:0:19269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919686.936939:0:19269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.936949:0:19269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.936970:0:19269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919686.936978:0:19269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee66df93/0x951c50ad15914ee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919686.937101:0:19269:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+19:2411:x1877914958305280:12345-192.168.203.11@tcp:4:dd.0 Request processed in 119915us (120964us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790919686.937112:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000001:00080000:2.0:1790919686.937157:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1790919686.937236:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.937246:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.937254:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.937260:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919686.937263:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919686.937270:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937520:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937530:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937537:0:19265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937544:0:19265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2ca00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919686.937547:0:19265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937555:0:19265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937580:0:19265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919686.937588:0:19265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e5168e/0x951c50ad15914ee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.937641:0:19265:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+11:2411:x1877914958305152:12345-192.168.203.11@tcp:4:dd.0 Request processed in 124146us (124395us total) trans 8589934603 rc 0/0 00010000:00010000:0.0:1790919686.937644:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919686.937649:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00010000:00010000:0.0:1790919686.937652:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d999e7d/0x951c50ad15914eee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919686.942261:0:19270:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e183cc62-cefd-4e26-96c7-4234fcebe0d8+9:2411:x1877914958305408:12345-192.168.203.11@tcp:4:dd.0 Request processed in 105481us (126073us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790919686.942275:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000001:00080000:2.0:1790919686.971271:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934606 is committed 00002000:00010000:1.0:1790919686.971575:0:17719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1790919686.971591:0:17719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.971621:0:17719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.971631:0:17719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.971638:0:17719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f380030400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919686.971643:0:17719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.971653:0:17719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.971671:0:17719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919686.971680:0:17719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8f1beaa/0x951c50ad15914ef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919686.971940:0:17719:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2411:x1877914958305536:12345-192.168.203.11@tcp:4:dd.0 Request processed in 80822us (144866us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1790919686.971950:0:17719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919687.068364:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919687.068389:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978291200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919687.068461:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919687.068561:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291200 00000100:00100000:1.0:1790919687.068569:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291200 00000100:00100000:1.0:1790919687.068623:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919687.068632:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978291200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919687.068667:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1790919687.068728:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2845a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978291200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919687.068735:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790919687.068817:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1790919687.068822:0:3459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f391516a00, transno 8589934596 00000004:00080000:3.0:1790919687.068837:0:3459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1790919687.068861:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978291200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919687.582028:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919687.582066:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978291328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919687.582133:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919687.582232:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291328 00000100:00100000:1.0:1790919687.582240:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291328 00000100:00100000:1.0:1790919687.582297:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919687.582306:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978291328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919687.582356:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919687.582403:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978291328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919687.582409:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919687.582630:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978291328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919687.582830:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978291456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919687.582859:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919687.582931:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291456 00000100:00100000:2.0:1790919687.582936:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291456 00000100:00100000:2.0:1790919687.582967:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790919687.582974:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978291456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919687.582995:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790919687.583034:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978291456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919687.583040:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790919687.583093:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978291456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790919687.836223:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790919688.122744:0:19307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1790919688.860266:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 40982 lines, 40982 kept, 0 dropped, 0 bad.